2024-09-18T00:20:54.665 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T00:20:54.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T00:20:54.767 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909651' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: rbd cache: true rbd cache policy: writeback global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1983 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 79/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6c/DLfu+Ybw7K9MoH8bC4kXW379TuBTEU4/HS81epgxhHL0PdYprXMigmNyIztuTdOgBmEqbia7jrHuyBbZUA= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2EZKWbcxjC3XMLj8XphdzU6iqbLTBySoSj/AcjlmZdgQuVP4Tr/953YovICI5h9HdK3qjzLCsLkXncsgfcQ0M= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_21:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T00:20:54.767 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa; will attempt to use it 2024-09-18T00:20:54.768 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa/tasks 2024-09-18T00:20:54.768 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T00:20:54.770 INFO:teuthology.task.internal:Checking packages... 2024-09-18T00:20:54.791 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-18T00:20:54.792 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T00:20:54.792 INFO:teuthology.packaging:ref: None 2024-09-18T00:20:54.792 INFO:teuthology.packaging:tag: None 2024-09-18T00:20:54.792 INFO:teuthology.packaging:branch: squid 2024-09-18T00:20:54.792 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T00:20:54.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T00:20:55.011 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-18T00:20:55.013 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T00:20:55.019 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T00:20:55.020 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T00:20:55.041 INFO:teuthology.task.internal:Saving configuration 2024-09-18T00:20:55.054 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T00:20:55.062 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T00:20:55.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 00:15:53.608399', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6c/DLfu+Ybw7K9MoH8bC4kXW379TuBTEU4/HS81epgxhHL0PdYprXMigmNyIztuTdOgBmEqbia7jrHuyBbZUA='} 2024-09-18T00:20:55.115 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 00:15:53.607135', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2EZKWbcxjC3XMLj8XphdzU6iqbLTBySoSj/AcjlmZdgQuVP4Tr/953YovICI5h9HdK3qjzLCsLkXncsgfcQ0M='} 2024-09-18T00:20:55.115 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T00:20:55.121 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-18T00:20:55.122 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-18T00:20:55.122 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T00:20:55.183 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f19ca6fb400>, signals=[15]) 2024-09-18T00:20:55.183 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T00:20:55.189 INFO:teuthology.task.internal:Opening connections... 2024-09-18T00:20:55.189 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:20:55.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:20:55.264 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:20:55.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:20:55.337 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T00:20:55.343 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-18T00:20:55.361 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-18T00:20:55.361 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-18T00:20:55.419 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-18T00:20:55.419 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T00:20:55.420 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T00:20:55.421 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-18T00:20:55.443 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-18T00:20:55.461 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-18T00:20:55.461 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-18T00:20:55.519 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-18T00:20:55.519 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-18T00:20:55.519 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-18T00:20:55.519 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-18T00:20:55.519 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-18T00:20:55.519 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T00:20:55.520 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T00:20:55.521 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-18T00:20:55.544 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T00:20:55.556 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T00:20:55.562 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T00:20:55.562 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-18T00:20:55.565 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-18T00:20:55.582 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T00:20:55.588 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T00:20:55.588 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-18T00:20:55.623 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-18T00:20:55.741 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T00:20:55.798 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T00:20:55.853 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T00:20:55.854 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T00:20:55.854 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T00:20:55.854 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T00:20:55.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:20:55.872 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-18T00:20:55.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:20:55.873 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-18T00:20:55.930 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-503.el9.x86_64 2024-09-18T00:20:55.931 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-503.el9.x86_64 2024-09-18T00:20:55.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2024-09-18T00:20:55.932 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-18T00:20:55.932 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-18T00:20:55.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-18T00:20:58.786 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.3 MB 00:01 2024-09-18T00:20:59.674 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-18T00:21:01.483 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-18T00:21:03.387 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-18T00:21:06.926 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-18T00:21:08.310 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-18T00:21:08.904 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-18T00:21:09.739 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-18T00:21:10.521 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-18T00:21:12.192 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-18T00:21:15.111 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-18T00:21:17.026 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T00:21:17.026 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T00:21:17.109 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:21:17.117 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:21:17.117 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-18T00:21:17.117 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-18T00:21:17.118 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:21:17.119 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 79 M 2024-09-18T00:21:17.119 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 126 M 2024-09-18T00:21:17.119 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:21:17.346 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 347 kB/s | 36 kB 00:00 2024-09-18T00:21:17.631 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-18T00:21:19.538 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T00:21:19.538 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T00:21:19.627 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T00:21:19.639 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-18T00:21:19.640 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-18T00:21:19.641 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:21:20.129 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:02 2024-09-18T00:21:20.325 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 65 kB/s | 36 kB 00:00 2024-09-18T00:21:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-18T00:21:22.058 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-18T00:21:22.575 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-18T00:21:22.575 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:21:22.576 INFO:teuthology.orchestra.run.smithi081.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-18T00:21:23.221 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.8 MB/s | 35 MB 00:05 2024-09-18T00:21:23.256 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:21:23.605 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:21:23.605 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:21:24.104 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.2 MB/s | 29 MB 00:06 2024-09-18T00:21:24.105 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:21:24.105 INFO:teuthology.orchestra.run.smithi167.stdout:Total 11 MB/s | 79 MB 00:06 2024-09-18T00:21:24.573 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:21:24.574 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:21:24.792 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:21:25.164 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:21:25.164 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:21:26.118 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:21:26.119 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:21:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:21:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T00:21:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T00:21:28.588 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:21:29.258 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T00:21:29.338 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T00:21:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T00:21:30.815 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T00:21:32.096 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T00:21:32.233 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T00:21:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T00:21:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:21:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T00:21:37.083 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:21:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:21:41.935 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:18.962 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:18.962 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T00:22:18.962 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T00:22:18.962 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T00:22:19.835 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:22:19.836 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:22:20.185 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T00:22:20.265 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T00:22:20.266 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T00:22:20.266 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T00:22:20.266 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T00:22:20.266 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T00:22:20.267 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T00:22:20.267 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T00:22:20.267 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T00:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T00:22:20.326 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T00:22:20.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-18T00:22:20.327 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-18T00:22:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T00:22:20.360 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-18T00:22:20.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:22:20.361 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T00:22:20.362 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T00:22:20.362 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-508.el9.x86_64 2024-09-18T00:22:20.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T00:22:20.366 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:20.736 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:20.736 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T00:22:20.736 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T00:22:20.736 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T00:22:21.077 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-18T00:22:21.600 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:22:21.601 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:22:21.984 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T00:22:22.076 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T00:22:22.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T00:22:22.076 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T00:22:22.076 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T00:22:22.077 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T00:22:22.077 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-18T00:22:22.077 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T00:22:22.077 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T00:22:22.136 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T00:22:22.136 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T00:22:22.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-09-18T00:22:22.173 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-09-18T00:22:22.173 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-09-18T00:22:22.173 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-09-18T00:22:22.173 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 82.el9 2024-09-18T00:22:22.173 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8274670 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-09-18T00:22:22.174 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:22:22.175 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T00:22:22.175 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T00:22:22.175 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T00:22:22.175 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-09-18T00:22:22.175 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:22:22.175 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T00:22:22.176 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T00:22:22.176 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-508.el9.x86_64 2024-09-18T00:22:22.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T00:22:22.402 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T00:22:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-18T00:22:22.432 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-18T00:22:22.448 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.yV9wiuB6xW 2024-09-18T00:22:22.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yV9wiuB6xW 2024-09-18T00:22:22.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.yV9wiuB6xW 2024-09-18T00:22:22.655 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.yV9wiuB6xW is 6KB 2024-09-18T00:22:22.705 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.yV9wiuB6xW 2024-09-18T00:22:22.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T00:22:22.784 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T00:22:22.784 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T00:22:22.785 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T00:22:22.785 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T00:22:22.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T00:22:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-18T00:22:22.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-18T00:22:24.156 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T00:22:24.176 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-18T00:22:24.178 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-18T00:22:24.194 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.KqeajJ6GhV 2024-09-18T00:22:24.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KqeajJ6GhV 2024-09-18T00:22:24.262 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.KqeajJ6GhV 2024-09-18T00:22:24.400 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.KqeajJ6GhV is 6KB 2024-09-18T00:22:24.448 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.KqeajJ6GhV 2024-09-18T00:22:24.462 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T00:22:24.526 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T00:22:24.526 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T00:22:24.526 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T00:22:24.526 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T00:22:24.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T00:22:24.685 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-18T00:22:52.974 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T00:22:52.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T00:22:52.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:22:54.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-18T00:22:54.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:22:54.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:23:11.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-18T00:23:13.213 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-18T00:23:20.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T00:23:20.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:23:22.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:23:22.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:23:23.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-18T00:23:25.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-18T00:23:35.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T00:23:35.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:23:37.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:23:37.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:23:55.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-18T00:24:07.307 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-18T00:24:07.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T00:24:07.740 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T00:24:07.740 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-18T00:24:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-508.el9.x86_64 2024-09-18T00:24:07.755 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T00:24:07.755 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T00:24:07.755 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T00:24:08.755 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T00:24:08.756 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T00:24:08.866 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-18T00:24:08.889 DEBUG:teuthology.parallel:result is None 2024-09-18T00:24:10.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:24:10.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:24:11.047 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-18T00:24:11.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:24:11.395 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-18T00:24:11.395 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-18T00:24:11.409 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-508.el9.x86_64 2024-09-18T00:24:11.410 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T00:24:11.410 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T00:24:11.410 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T00:24:12.410 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-18T00:24:12.411 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T00:24:12.495 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-18T00:24:12.518 DEBUG:teuthology.parallel:result is None 2024-09-18T00:24:12.518 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T00:24:12.525 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T00:24:12.525 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T00:24:12.528 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T00:24:12.544 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T00:24:12.550 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T00:24:12.560 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T00:24:12.561 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T00:24:12.587 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T00:24:12.682 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T00:24:12.689 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T00:24:12.689 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T00:24:12.692 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T00:24:12.717 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T00:24:12.727 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T00:24:12.728 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T00:24:12.739 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T00:24:12.741 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T00:24:12.747 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T00:24:12.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T00:24:12.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T00:24:12.813 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T00:24:12.823 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T00:24:12.823 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T00:24:12.851 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T00:24:12.867 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T00:24:12.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T00:24:12.999 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T00:24:13.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T00:24:13.123 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:24:13.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T00:24:13.188 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T00:24:13.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T00:24:13.354 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T00:24:13.397 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T00:24:13.436 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:24:13.436 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T00:24:13.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-18T00:24:13.506 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-18T00:24:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T00:24:13.716 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T00:24:13.936 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T00:24:13.944 INFO:teuthology.task.internal:Starting timer... 2024-09-18T00:24:13.945 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T00:24:13.955 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T00:24:13.963 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-18T00:24:13.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-18T00:24:14.022 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-18T00:24:14.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-18T00:24:14.134 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-18T00:24:14.138 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T00:24:14.138 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-18T00:24:14.167 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-18T00:24:14.168 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-18T00:24:14.206 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-18T00:24:14.207 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-18T00:24:14.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T00:24:14.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:24:14.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T00:24:14.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:24:14.295 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T00:24:14.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-18T00:24:14.325 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-18T00:24:14.395 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T00:24:14.404 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-18T00:24:14.407 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-18T00:24:14.546 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T00:24:14.558 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T00:24:14.559 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T00:28:00.043 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-18T00:28:00.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T00:28:00.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:28:00.129 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-18T00:28:00.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-18T00:28:00.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:28:00.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T00:28:00.281 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-18T00:28:00.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-18T00:28:00.360 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T00:28:00.369 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T00:28:00.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T00:28:00.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T00:28:00.372 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T00:28:00.372 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T00:28:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T00:28:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T00:28:00.430 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T00:28:00.437 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-18T00:28:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T00:28:00.448 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-18T00:28:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T00:28:00.469 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-18T00:28:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T00:28:00.480 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-18T00:28:00.494 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T00:28:00.508 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T00:28:00.542 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-18T00:28:00.545 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T00:28:00.545 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-18T00:28:00.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.576 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-18T00:28:00.579 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T00:28:00.579 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-18T00:28:00.580 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.580 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.580 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.580 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:28:00.584 INFO:teuthology.run_tasks:Running task install... 2024-09-18T00:28:00.591 DEBUG:teuthology.task.install:project ceph 2024-09-18T00:28:00.592 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-18T00:28:00.592 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-18T00:28:00.592 INFO:teuthology.task.install:Using flavor: default 2024-09-18T00:28:00.597 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T00:28:00.598 INFO:teuthology.task.install:extra packages: [] 2024-09-18T00:28:00.598 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-18T00:28:00.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T00:28:00.601 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-18T00:28:00.601 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T00:28:00.746 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-18T00:28:00.746 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-18T00:28:00.749 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-18T00:28:00.749 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-18T00:28:00.856 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T00:28:00.856 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:28:00.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T00:28:00.862 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T00:28:00.862 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:28:00.862 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T00:28:00.881 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T00:28:00.882 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T00:28:00.887 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T00:28:00.887 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T00:28:00.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T00:28:00.953 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T00:28:01.022 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T00:28:01.028 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T00:28:01.087 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-18T00:28:01.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-18T00:28:01.093 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-18T00:28:01.095 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-18T00:28:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-18T00:28:01.326 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-18T00:28:01.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw 2024-09-18T00:28:01.354 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw 2024-09-18T00:28:01.892 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 331 kB/s | 84 kB 00:00 2024-09-18T00:28:01.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-18T00:28:02.159 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-18T00:28:02.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-18T00:28:02.426 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-18T00:28:02.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-18T00:28:04.168 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-18T00:28:04.971 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.3 MB 00:02 2024-09-18T00:28:06.087 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-18T00:28:10.912 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.5 MB 00:01 2024-09-18T00:28:12.754 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-18T00:28:14.184 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-18T00:28:19.615 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-18T00:28:21.834 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:28:21.851 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:28:21.851 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:28:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T00:28:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-18T00:28:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-18T00:28:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-18T00:28:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T00:28:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T00:28:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T00:28:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-18T00:28:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T00:28:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T00:28:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T00:28:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-18T00:28:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-18T00:28:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T00:28:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout:Install 30 Packages 2024-09-18T00:28:21.857 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2024-09-18T00:28:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:21.858 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 60 M 2024-09-18T00:28:21.859 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:28:22.566 INFO:teuthology.orchestra.run.smithi081.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-18T00:28:22.625 INFO:teuthology.orchestra.run.smithi081.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 432 kB/s | 25 kB 00:00 2024-09-18T00:28:22.725 INFO:teuthology.orchestra.run.smithi081.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 7.4 MB/s | 751 kB 00:00 2024-09-18T00:28:22.817 INFO:teuthology.orchestra.run.smithi081.stdout:(4/32): libradosstriper1-19.1.1-330.gc2ddf972.e 5.4 MB/s | 506 kB 00:00 2024-09-18T00:28:23.109 INFO:teuthology.orchestra.run.smithi081.stdout:(5/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 11 MB/s | 11 MB 00:00 2024-09-18T00:28:23.209 INFO:teuthology.orchestra.run.smithi081.stdout:(6/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 14 MB/s | 5.3 MB 00:00 2024-09-18T00:28:23.234 INFO:teuthology.orchestra.run.smithi081.stdout:(7/32): python3-ceph-argparse-19.1.1-330.gc2ddf 361 kB/s | 45 kB 00:00 2024-09-18T00:28:23.260 INFO:teuthology.orchestra.run.smithi081.stdout:(8/32): python3-ceph-common-19.1.1-330.gc2ddf97 2.7 MB/s | 136 kB 00:00 2024-09-18T00:28:23.285 INFO:teuthology.orchestra.run.smithi081.stdout:(9/32): python3-cephfs-19.1.1-330.gc2ddf972.el9 3.1 MB/s | 162 kB 00:00 2024-09-18T00:28:23.286 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-18T00:28:23.502 INFO:teuthology.orchestra.run.smithi081.stdout:(10/32): ceph-common-19.1.1-330.gc2ddf972.el9.x 15 MB/s | 21 MB 00:01 2024-09-18T00:28:23.527 INFO:teuthology.orchestra.run.smithi081.stdout:(11/32): python3-rados-19.1.1-330.gc2ddf972.el9 1.2 MB/s | 320 kB 00:00 2024-09-18T00:28:23.553 INFO:teuthology.orchestra.run.smithi081.stdout:(12/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-18T00:28:23.578 INFO:teuthology.orchestra.run.smithi081.stdout:(13/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 1.0 MB/s | 300 kB 00:00 2024-09-18T00:28:23.687 INFO:teuthology.orchestra.run.smithi081.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-18T00:28:23.720 INFO:teuthology.orchestra.run.smithi081.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 556 kB/s | 107 kB 00:00 2024-09-18T00:28:23.754 INFO:teuthology.orchestra.run.smithi081.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 798 kB/s | 160 kB 00:00 2024-09-18T00:28:23.805 INFO:teuthology.orchestra.run.smithi081.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-18T00:28:23.829 INFO:teuthology.orchestra.run.smithi081.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 562 kB/s | 42 kB 00:00 2024-09-18T00:28:23.863 INFO:teuthology.orchestra.run.smithi081.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-18T00:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 613 kB/s | 36 kB 00:00 2024-09-18T00:28:23.916 INFO:teuthology.orchestra.run.smithi081.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-18T00:28:23.939 INFO:teuthology.orchestra.run.smithi081.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-18T00:28:24.014 INFO:teuthology.orchestra.run.smithi081.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 433 kB/s | 26 kB 00:00 2024-09-18T00:28:24.040 INFO:teuthology.orchestra.run.smithi081.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2024-09-18T00:28:24.065 INFO:teuthology.orchestra.run.smithi081.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-18T00:28:24.090 INFO:teuthology.orchestra.run.smithi081.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T00:28:24.157 INFO:teuthology.orchestra.run.smithi081.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-18T00:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-09-18T00:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-18T00:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout:(30/32): librados2-19.1.1-330.gc2ddf972.el9.x86 14 MB/s | 3.4 MB 00:00 2024-09-18T00:28:24.708 INFO:teuthology.orchestra.run.smithi081.stdout:(31/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 14 MB/s | 3.2 MB 00:00 2024-09-18T00:28:24.842 INFO:teuthology.orchestra.run.smithi081.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-09-18T00:28:24.848 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:28:24.848 INFO:teuthology.orchestra.run.smithi081.stdout:Total 20 MB/s | 60 MB 00:02 2024-09-18T00:28:24.956 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:28:24.992 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:28:24.992 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:28:25.645 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:28:25.646 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:28:27.108 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:28:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T00:28:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T00:28:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T00:28:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T00:28:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T00:28:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T00:28:27.525 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T00:28:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T00:28:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T00:28:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T00:28:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-18T00:28:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T00:28:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T00:28:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T00:28:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-18T00:28:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T00:28:28.396 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-18T00:28:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T00:28:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T00:28:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T00:28:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T00:28:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T00:28:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T00:28:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T00:28:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T00:28:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T00:28:29.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T00:28:29.142 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T00:28:29.219 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T00:28:29.246 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-18T00:28:29.282 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T00:28:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T00:28:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T00:28:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T00:28:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-18T00:28:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-18T00:28:30.088 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-18T00:28:31.868 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-18T00:28:32.265 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T00:28:32.318 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T00:28:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T00:28:32.913 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T00:28:33.007 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T00:28:33.007 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T00:28:33.008 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T00:28:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T00:28:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-18T00:28:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-18T00:28:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T00:28:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-18T00:28:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:Install 30 Packages 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 2 Packages 2024-09-18T00:28:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:28:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 60 M 2024-09-18T00:28:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:28:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-18T00:28:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 608 kB/s | 25 kB 00:00 2024-09-18T00:28:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-18T00:28:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:(4/32): libradosstriper1-19.1.1-330.gc2ddf972.e 5.4 MB/s | 506 kB 00:00 2024-09-18T00:28:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:(5/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 11 MB/s | 11 MB 00:01 2024-09-18T00:28:41.169 INFO:teuthology.orchestra.run.smithi167.stdout:(6/32): ceph-common-19.1.1-330.gc2ddf972.el9.x8 17 MB/s | 21 MB 00:01 2024-09-18T00:28:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:(7/32): python3-ceph-argparse-19.1.1-330.gc2ddf 180 kB/s | 45 kB 00:00 2024-09-18T00:28:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:(8/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 8.7 MB/s | 5.3 MB 00:00 2024-09-18T00:28:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:(9/32): python3-ceph-common-19.1.1-330.gc2ddf97 1.1 MB/s | 136 kB 00:00 2024-09-18T00:28:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:(10/32): python3-cephfs-19.1.1-330.gc2ddf972.el 1.3 MB/s | 162 kB 00:00 2024-09-18T00:28:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:(11/32): python3-rados-19.1.1-330.gc2ddf972.el9 4.1 MB/s | 320 kB 00:00 2024-09-18T00:28:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:(12/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 3.9 MB/s | 300 kB 00:00 2024-09-18T00:28:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:(13/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.2 MB/s | 99 kB 00:00 2024-09-18T00:28:41.763 INFO:teuthology.orchestra.run.smithi167.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2024-09-18T00:28:41.855 INFO:teuthology.orchestra.run.smithi167.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 217 kB/s | 107 kB 00:00 2024-09-18T00:28:41.938 INFO:teuthology.orchestra.run.smithi167.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 278 kB/s | 160 kB 00:00 2024-09-18T00:28:42.086 INFO:teuthology.orchestra.run.smithi167.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 286 kB/s | 42 kB 00:00 2024-09-18T00:28:42.164 INFO:teuthology.orchestra.run.smithi167.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 946 kB/s | 292 kB 00:00 2024-09-18T00:28:42.231 INFO:teuthology.orchestra.run.smithi167.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-09-18T00:28:42.273 INFO:teuthology.orchestra.run.smithi167.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 330 kB/s | 36 kB 00:00 2024-09-18T00:28:42.340 INFO:teuthology.orchestra.run.smithi167.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-18T00:28:42.373 INFO:teuthology.orchestra.run.smithi167.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 768 kB/s | 221 kB 00:00 2024-09-18T00:28:42.416 INFO:teuthology.orchestra.run.smithi167.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-18T00:28:42.449 INFO:teuthology.orchestra.run.smithi167.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 353 kB/s | 26 kB 00:00 2024-09-18T00:28:42.475 INFO:teuthology.orchestra.run.smithi167.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 856 kB/s | 49 kB 00:00 2024-09-18T00:28:42.508 INFO:teuthology.orchestra.run.smithi167.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-18T00:28:42.567 INFO:teuthology.orchestra.run.smithi167.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-18T00:28:42.659 INFO:teuthology.orchestra.run.smithi167.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-09-18T00:28:42.834 INFO:teuthology.orchestra.run.smithi167.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-09-18T00:28:42.959 INFO:teuthology.orchestra.run.smithi167.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-18T00:28:43.018 INFO:teuthology.orchestra.run.smithi167.stdout:(31/32): librados2-19.1.1-330.gc2ddf972.el9.x86 9.5 MB/s | 3.4 MB 00:00 2024-09-18T00:28:43.152 INFO:teuthology.orchestra.run.smithi167.stdout:(32/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 10 MB/s | 3.2 MB 00:00 2024-09-18T00:28:43.155 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:28:43.156 INFO:teuthology.orchestra.run.smithi167.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-18T00:28:43.256 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-18T00:28:43.270 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-18T00:28:43.271 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-18T00:28:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:43.292 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:28:43.292 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:28:43.935 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:28:43.935 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:28:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T00:28:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T00:28:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:28:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T00:28:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T00:28:44.259 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T00:28:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T00:28:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T00:28:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T00:28:45.409 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:28:45.478 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-18T00:28:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T00:28:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T00:28:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-18T00:28:45.515 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T00:28:45.540 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T00:28:45.563 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T00:28:45.584 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T00:28:45.783 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T00:28:45.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T00:28:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T00:28:46.284 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T00:28:46.400 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T00:28:46.435 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T00:28:46.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:46.435 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-18T00:28:46.435 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T00:28:46.436 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:46.438 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:28:46.500 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-18T00:28:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T00:28:46.591 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T00:28:46.620 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T00:28:46.664 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-18T00:28:46.742 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T00:28:46.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-test 2024-09-18T00:28:46.764 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T00:28:46.828 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T00:28:46.870 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T00:28:46.981 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T00:28:47.013 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T00:28:47.061 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T00:28:47.095 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T00:28:47.133 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T00:28:47.175 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T00:28:47.343 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:28:47.473 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:28:47.473 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-18T00:28:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 49 M 2024-09-18T00:28:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 209 M 2024-09-18T00:28:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:28:47.487 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T00:28:47.537 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T00:28:47.628 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T00:28:47.659 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-18T00:28:47.695 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T00:28:47.707 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-18T00:28:47.733 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 702 kB/s | 163 kB 00:00 2024-09-18T00:28:47.758 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-18T00:28:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T00:28:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T00:28:48.302 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T00:28:48.381 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-18T00:28:48.418 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-18T00:28:49.042 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-18T00:28:49.044 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:28:49.044 INFO:teuthology.orchestra.run.smithi081.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-18T00:28:49.072 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:28:49.093 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:28:49.093 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:28:49.472 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:28:49.472 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:28:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:28:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T00:28:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T00:28:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T00:28:50.769 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T00:28:50.807 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T00:28:51.376 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T00:28:51.410 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T00:28:51.502 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T00:28:51.502 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T00:28:51.502 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T00:28:51.502 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:28:51.536 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T00:28:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T00:28:54.859 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T00:28:57.318 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T00:28:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-18T00:28:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-18T00:28:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T00:28:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:57.625 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:28:57.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph 2024-09-18T00:28:58.480 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:28:58.626 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:28:58.628 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:58.628 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:28:58.628 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T00:28:58.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T00:28:58.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T00:28:58.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T00:28:58.632 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:58.632 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:28:58.632 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:28:58.632 INFO:teuthology.orchestra.run.smithi081.stdout:Install 37 Packages 2024-09-18T00:28:58.632 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:28:58.633 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 30 M 2024-09-18T00:28:58.633 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 108 M 2024-09-18T00:28:58.633 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:28:59.460 INFO:teuthology.orchestra.run.smithi081.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 45 kB/s | 6.5 kB 00:00 2024-09-18T00:28:59.644 INFO:teuthology.orchestra.run.smithi081.stdout:(2/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 4.6 MB/s | 1.5 MB 00:00 2024-09-18T00:28:59.703 INFO:teuthology.orchestra.run.smithi081.stdout:(3/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 6.1 MB/s | 2.4 MB 00:00 2024-09-18T00:28:59.769 INFO:teuthology.orchestra.run.smithi081.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 3.7 MB/s | 249 kB 00:00 2024-09-18T00:28:59.962 INFO:teuthology.orchestra.run.smithi081.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-18T00:29:00.212 INFO:teuthology.orchestra.run.smithi081.stdout:(6/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-18T00:29:00.308 INFO:teuthology.orchestra.run.smithi081.stdout:(7/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 5.6 MB/s | 4.7 MB 00:00 2024-09-18T00:29:00.337 INFO:teuthology.orchestra.run.smithi081.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.3 MB/s | 1.2 MB 00:00 2024-09-18T00:29:00.388 INFO:teuthology.orchestra.run.smithi081.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-18T00:29:00.446 INFO:teuthology.orchestra.run.smithi081.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-18T00:29:00.471 INFO:teuthology.orchestra.run.smithi081.stdout:(11/37): python3-ply-3.11-14.el9.noarch.rpm 411 kB/s | 106 kB 00:00 2024-09-18T00:29:00.497 INFO:teuthology.orchestra.run.smithi081.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 719 kB/s | 135 kB 00:00 2024-09-18T00:29:00.780 INFO:teuthology.orchestra.run.smithi081.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 123 kB/s | 35 kB 00:00 2024-09-18T00:29:01.006 INFO:teuthology.orchestra.run.smithi081.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 337 kB/s | 188 kB 00:00 2024-09-18T00:29:01.031 INFO:teuthology.orchestra.run.smithi081.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 308 kB/s | 172 kB 00:00 2024-09-18T00:29:01.064 INFO:teuthology.orchestra.run.smithi081.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 272 kB/s | 77 kB 00:00 2024-09-18T00:29:01.115 INFO:teuthology.orchestra.run.smithi081.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-18T00:29:01.140 INFO:teuthology.orchestra.run.smithi081.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-09-18T00:29:01.165 INFO:teuthology.orchestra.run.smithi081.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 309 kB/s | 42 kB 00:00 2024-09-18T00:29:01.224 INFO:teuthology.orchestra.run.smithi081.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 519 kB/s | 43 kB 00:00 2024-09-18T00:29:01.249 INFO:teuthology.orchestra.run.smithi081.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-18T00:29:01.275 INFO:teuthology.orchestra.run.smithi081.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 427 kB/s | 11 kB 00:00 2024-09-18T00:29:01.300 INFO:teuthology.orchestra.run.smithi081.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-09-18T00:29:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-18T00:29:01.350 INFO:teuthology.orchestra.run.smithi081.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2024-09-18T00:29:01.375 INFO:teuthology.orchestra.run.smithi081.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-09-18T00:29:01.413 INFO:teuthology.orchestra.run.smithi081.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 224 kB/s | 19 kB 00:00 2024-09-18T00:29:01.438 INFO:teuthology.orchestra.run.smithi081.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 226 kB/s | 20 kB 00:00 2024-09-18T00:29:01.453 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T00:29:01.453 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-18T00:29:01.454 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:01.463 INFO:teuthology.orchestra.run.smithi081.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-18T00:29:01.480 INFO:teuthology.orchestra.run.smithi081.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-18T00:29:01.505 INFO:teuthology.orchestra.run.smithi081.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 393 kB/s | 16 kB 00:00 2024-09-18T00:29:01.530 INFO:teuthology.orchestra.run.smithi081.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-18T00:29:01.556 INFO:teuthology.orchestra.run.smithi081.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-18T00:29:01.573 INFO:teuthology.orchestra.run.smithi081.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 534 kB/s | 36 kB 00:00 2024-09-18T00:29:01.598 INFO:teuthology.orchestra.run.smithi081.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-18T00:29:01.623 INFO:teuthology.orchestra.run.smithi081.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-18T00:29:01.665 INFO:teuthology.orchestra.run.smithi081.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-18T00:29:01.668 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:01.668 INFO:teuthology.orchestra.run.smithi081.stdout:Total 10 MB/s | 30 MB 00:03 2024-09-18T00:29:01.820 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:01.860 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:01.860 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:02.317 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:02.318 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:02.477 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T00:29:02.503 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T00:29:02.503 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:02.504 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T00:29:02.504 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T00:29:02.504 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T00:29:02.504 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:02.506 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T00:29:02.580 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T00:29:02.580 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T00:29:03.692 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-18T00:29:03.758 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T00:29:03.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T00:29:03.760 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T00:29:03.761 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-18T00:29:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T00:29:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T00:29:03.829 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T00:29:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T00:29:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T00:29:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T00:29:04.076 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T00:29:04.155 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T00:29:04.196 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T00:29:04.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T00:29:04.261 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T00:29:04.296 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T00:29:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T00:29:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T00:29:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T00:29:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T00:29:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T00:29:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T00:29:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T00:29:04.638 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T00:29:04.638 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:04.638 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-18T00:29:04.638 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T00:29:04.639 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:04.640 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T00:29:04.641 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T00:29:04.641 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T00:29:04.641 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T00:29:04.641 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T00:29:04.641 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:04.641 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T00:29:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T00:29:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T00:29:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T00:29:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T00:29:04.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-test 2024-09-18T00:29:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T00:29:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T00:29:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T00:29:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T00:29:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T00:29:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T00:29:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T00:29:05.576 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:05.717 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:05.717 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:05.717 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-18T00:29:05.718 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:05.719 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 49 M 2024-09-18T00:29:05.719 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 209 M 2024-09-18T00:29:05.719 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:29:05.730 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-18T00:29:05.753 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T00:29:05.779 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T00:29:05.779 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:05.780 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T00:29:05.780 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T00:29:05.780 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T00:29:05.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:06.079 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 756 kB/s | 163 kB 00:00 2024-09-18T00:29:06.654 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 384 kB/s | 304 kB 00:00 2024-09-18T00:29:06.713 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-09-18T00:29:07.229 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T00:29:07.256 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T00:29:07.257 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:07.257 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T00:29:07.257 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T00:29:07.257 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T00:29:07.257 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:07.397 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-18T00:29:07.400 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:07.400 INFO:teuthology.orchestra.run.smithi167.stdout:Total 29 MB/s | 49 MB 00:01 2024-09-18T00:29:07.428 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:29:07.448 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:29:07.448 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:29:07.697 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T00:29:07.720 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T00:29:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T00:29:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T00:29:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T00:29:07.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:07.842 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:29:07.842 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:29:07.956 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T00:29:07.980 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T00:29:07.980 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:07.980 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T00:29:07.980 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T00:29:07.980 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T00:29:07.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T00:29:08.362 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:29:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T00:29:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T00:29:08.516 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T00:29:09.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T00:29:09.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T00:29:09.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T00:29:09.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T00:29:09.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T00:29:09.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T00:29:09.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T00:29:09.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T00:29:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T00:29:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T00:29:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:11.012 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:11.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-base 2024-09-18T00:29:11.939 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:12.028 INFO:teuthology.orchestra.run.smithi081.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:12.070 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:12.071 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:12.071 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:12.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install cephadm 2024-09-18T00:29:12.711 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:12.841 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:12.842 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:12.842 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:12.842 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 765 k 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 771 k 2024-09-18T00:29:12.843 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:13.089 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 3.0 MB/s | 765 kB 00:00 2024-09-18T00:29:13.090 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:13.090 INFO:teuthology.orchestra.run.smithi081.stdout:Total 3.0 MB/s | 765 kB 00:00 2024-09-18T00:29:13.090 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:13.095 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:13.095 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:13.101 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:13.102 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:13.171 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T00:29:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T00:29:13.601 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:14.127 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:14.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:14.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:14.328 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:14.328 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:14.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:14.328 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:14.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T00:29:15.149 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:15.282 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:15.284 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:29:15.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:15.284 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 145 k 2024-09-18T00:29:15.284 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 435 k 2024-09-18T00:29:15.285 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:15.496 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 687 kB/s | 145 kB 00:00 2024-09-18T00:29:15.496 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:15.497 INFO:teuthology.orchestra.run.smithi081.stdout:Total 681 kB/s | 145 kB 00:00 2024-09-18T00:29:15.497 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:15.562 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:15.563 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:15.707 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T00:29:15.707 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-18T00:29:15.707 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-18T00:29:15.707 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T00:29:15.720 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:15.789 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T00:29:15.813 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T00:29:15.813 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:15.814 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T00:29:15.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T00:29:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:16.069 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T00:29:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T00:29:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:16.070 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:16.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph 2024-09-18T00:29:16.698 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T00:29:16.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:16.699 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:16.699 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:16.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:16.699 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:16.960 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:16.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr 2024-09-18T00:29:17.110 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:29:17.113 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T00:29:17.114 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T00:29:17.115 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout:Install 37 Packages 2024-09-18T00:29:17.116 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:17.117 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 30 M 2024-09-18T00:29:17.117 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 108 M 2024-09-18T00:29:17.117 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:29:17.475 INFO:teuthology.orchestra.run.smithi167.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 52 kB/s | 6.5 kB 00:00 2024-09-18T00:29:17.552 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:58 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:17.634 INFO:teuthology.orchestra.run.smithi167.stdout:(2/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 5.3 MB/s | 1.5 MB 00:00 2024-09-18T00:29:17.644 INFO:teuthology.orchestra.run.smithi081.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:17.686 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:17.687 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:17.687 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:(3/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 6.9 MB/s | 2.4 MB 00:00 2024-09-18T00:29:17.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T00:29:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 2.9 MB/s | 249 kB 00:00 2024-09-18T00:29:17.914 INFO:teuthology.orchestra.run.smithi167.stdout:(5/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-18T00:29:18.231 INFO:teuthology.orchestra.run.smithi167.stdout:(6/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-18T00:29:18.323 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:59 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:18.452 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:18.453 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:18.453 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T00:29:18.454 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:Install 12 Packages 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 8.7 M 2024-09-18T00:29:18.456 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 104 M 2024-09-18T00:29:18.456 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:18.800 INFO:teuthology.orchestra.run.smithi081.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 213 kB/s | 32 kB 00:00 2024-09-18T00:29:18.825 INFO:teuthology.orchestra.run.smithi081.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 94 kB/s | 16 kB 00:00 2024-09-18T00:29:18.873 INFO:teuthology.orchestra.run.smithi167.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 231 kB/s | 253 kB 00:01 2024-09-18T00:29:18.907 INFO:teuthology.orchestra.run.smithi167.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 161 kB/s | 106 kB 00:00 2024-09-18T00:29:18.959 INFO:teuthology.orchestra.run.smithi081.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-18T00:29:18.999 INFO:teuthology.orchestra.run.smithi167.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-18T00:29:19.017 INFO:teuthology.orchestra.run.smithi081.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-18T00:29:19.076 INFO:teuthology.orchestra.run.smithi081.stdout:(5/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 8.4 MB/s | 3.6 MB 00:00 2024-09-18T00:29:19.135 INFO:teuthology.orchestra.run.smithi081.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 378 kB/s | 19 kB 00:00 2024-09-18T00:29:19.243 INFO:teuthology.orchestra.run.smithi081.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.4 MB/s | 548 kB 00:00 2024-09-18T00:29:19.269 INFO:teuthology.orchestra.run.smithi081.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-09-18T00:29:19.311 INFO:teuthology.orchestra.run.smithi081.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-18T00:29:19.344 INFO:teuthology.orchestra.run.smithi081.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 408 kB/s | 31 kB 00:00 2024-09-18T00:29:19.411 INFO:teuthology.orchestra.run.smithi081.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.9 MB/s | 188 kB 00:00 2024-09-18T00:29:19.536 INFO:teuthology.orchestra.run.smithi081.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.1 MB/s | 2.0 MB 00:00 2024-09-18T00:29:19.540 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:19.540 INFO:teuthology.orchestra.run.smithi081.stdout:Total 8.0 MB/s | 8.7 MB 00:01 2024-09-18T00:29:19.588 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:19.605 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:19.606 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:19.632 INFO:teuthology.orchestra.run.smithi167.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 178 kB/s | 135 kB 00:00 2024-09-18T00:29:19.666 INFO:teuthology.orchestra.run.smithi167.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 165 kB/s | 125 kB 00:00 2024-09-18T00:29:19.816 INFO:teuthology.orchestra.run.smithi167.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 263 kB/s | 215 kB 00:00 2024-09-18T00:29:19.829 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:19.830 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:20.374 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:20.391 INFO:teuthology.orchestra.run.smithi167.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 60 kB/s | 35 kB 00:00 2024-09-18T00:29:20.416 INFO:teuthology.orchestra.run.smithi167.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 240 kB/s | 188 kB 00:00 2024-09-18T00:29:20.437 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T00:29:20.467 INFO:teuthology.orchestra.run.smithi167.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 215 kB/s | 172 kB 00:00 2024-09-18T00:29:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T00:29:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T00:29:20.566 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T00:29:20.671 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T00:29:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T00:29:20.894 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T00:29:20.937 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T00:29:20.966 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T00:29:20.998 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-18T00:29:21.025 INFO:teuthology.orchestra.run.smithi167.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2024-09-18T00:29:21.051 INFO:teuthology.orchestra.run.smithi167.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-18T00:29:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-09-18T00:29:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 653 kB/s | 43 kB 00:00 2024-09-18T00:29:21.168 INFO:teuthology.orchestra.run.smithi167.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-18T00:29:21.193 INFO:teuthology.orchestra.run.smithi167.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-09-18T00:29:21.219 INFO:teuthology.orchestra.run.smithi167.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-18T00:29:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 688 kB/s | 18 kB 00:00 2024-09-18T00:29:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 742 kB/s | 23 kB 00:00 2024-09-18T00:29:21.311 INFO:teuthology.orchestra.run.smithi167.stdout:(25/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 91 kB/s | 11 kB 00:00 2024-09-18T00:29:21.337 INFO:teuthology.orchestra.run.smithi167.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-18T00:29:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.8 MB/s | 358 kB 00:00 2024-09-18T00:29:21.387 INFO:teuthology.orchestra.run.smithi167.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 259 kB/s | 20 kB 00:00 2024-09-18T00:29:21.413 INFO:teuthology.orchestra.run.smithi167.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 611 kB/s | 46 kB 00:00 2024-09-18T00:29:21.438 INFO:teuthology.orchestra.run.smithi167.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T00:29:21.455 INFO:teuthology.orchestra.run.smithi167.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-09-18T00:29:21.505 INFO:teuthology.orchestra.run.smithi167.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-18T00:29:21.539 INFO:teuthology.orchestra.run.smithi167.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 895 kB/s | 90 kB 00:00 2024-09-18T00:29:21.564 INFO:teuthology.orchestra.run.smithi167.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 329 kB/s | 36 kB 00:00 2024-09-18T00:29:21.598 INFO:teuthology.orchestra.run.smithi167.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-18T00:29:21.623 INFO:teuthology.orchestra.run.smithi167.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 342 kB/s | 20 kB 00:00 2024-09-18T00:29:21.690 INFO:teuthology.orchestra.run.smithi167.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-18T00:29:21.696 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:21.696 INFO:teuthology.orchestra.run.smithi167.stdout:Total 6.6 MB/s | 30 MB 00:04 2024-09-18T00:29:21.853 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:29:21.895 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:29:21.895 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:29:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-18T00:29:22.090 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T00:29:22.373 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:29:22.373 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:29:23.483 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T00:29:23.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-18T00:29:23.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T00:29:23.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T00:29:23.757 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:29:23.826 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T00:29:23.829 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T00:29:23.830 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T00:29:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T00:29:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T00:29:23.831 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:23.831 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:23.870 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T00:29:23.904 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T00:29:23.976 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T00:29:24.011 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T00:29:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T00:29:24.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T00:29:24.145 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T00:29:24.225 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T00:29:24.266 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T00:29:24.301 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T00:29:24.331 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T00:29:24.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T00:29:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T00:29:24.439 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T00:29:24.488 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T00:29:24.522 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T00:29:24.571 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T00:29:24.603 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T00:29:24.647 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:05 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T00:29:24.780 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T00:29:24.781 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout:Install 12 Packages 2024-09-18T00:29:24.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:24.783 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 38 M 2024-09-18T00:29:24.783 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 212 M 2024-09-18T00:29:24.783 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:24.816 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T00:29:24.895 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T00:29:24.956 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T00:29:24.995 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T00:29:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T00:29:25.125 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T00:29:25.270 INFO:teuthology.orchestra.run.smithi081.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-18T00:29:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T00:29:25.328 INFO:teuthology.orchestra.run.smithi081.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.6 MB/s | 801 kB 00:00 2024-09-18T00:29:25.354 INFO:teuthology.orchestra.run.smithi081.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-18T00:29:25.366 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T00:29:25.396 INFO:teuthology.orchestra.run.smithi081.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-18T00:29:25.446 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T00:29:25.454 INFO:teuthology.orchestra.run.smithi081.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 661 kB/s | 38 kB 00:00 2024-09-18T00:29:25.544 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T00:29:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T00:29:25.613 INFO:teuthology.orchestra.run.smithi081.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-33 16 MB/s | 7.4 MB 00:00 2024-09-18T00:29:25.671 INFO:teuthology.orchestra.run.smithi081.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.7 MB/s | 3.0 MB 00:00 2024-09-18T00:29:25.716 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T00:29:25.797 INFO:teuthology.orchestra.run.smithi081.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 5.1 MB 00:00 2024-09-18T00:29:25.879 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-18T00:29:25.880 INFO:teuthology.orchestra.run.smithi081.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-09-18T00:29:25.905 INFO:teuthology.orchestra.run.smithi081.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 837 kB/s | 245 kB 00:00 2024-09-18T00:29:25.909 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T00:29:25.930 INFO:teuthology.orchestra.run.smithi081.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-18T00:29:25.936 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T00:29:25.936 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:25.936 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T00:29:25.936 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T00:29:25.936 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T00:29:25.936 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:26.165 INFO:teuthology.orchestra.run.smithi081.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 57 MB/s | 16 MB 00:00 2024-09-18T00:29:26.165 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:26.165 INFO:teuthology.orchestra.run.smithi081.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-18T00:29:26.519 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:26.546 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:26.546 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T00:29:27.404 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T00:29:27.404 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:27.404 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T00:29:27.405 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T00:29:27.405 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T00:29:27.405 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T00:29:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T00:29:27.844 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T00:29:27.868 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T00:29:27.869 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:27.869 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T00:29:27.869 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T00:29:27.869 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T00:29:27.869 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T00:29:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T00:29:28.095 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T00:29:28.118 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T00:29:28.119 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:28.119 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T00:29:28.119 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T00:29:28.119 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T00:29:28.119 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T00:29:28.183 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T00:29:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T00:29:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T00:29:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T00:29:29.042 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T00:29:30.088 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T00:29:30.089 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T00:29:30.090 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T00:29:30.090 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T00:29:30.091 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T00:29:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T00:29:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T00:29:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T00:29:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T00:29:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T00:29:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T00:29:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:31.068 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T00:29:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T00:29:31.479 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-base 2024-09-18T00:29:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:29:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:32.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install cephadm 2024-09-18T00:29:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:32.987 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:29:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 765 k 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 771 k 2024-09-18T00:29:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:29:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-18T00:29:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-18T00:29:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:29:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:29:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:29:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:29:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:29:33.330 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:29:33.782 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:33.875 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T00:29:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T00:29:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T00:29:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T00:29:34.240 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T00:29:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:34.323 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:34.324 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:34.482 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:34.482 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:34.482 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:34.483 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:34.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-rook 2024-09-18T00:29:34.735 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T00:29:35.260 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:16 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:58 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:35.391 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T00:29:35.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:35.393 INFO:teuthology.orchestra.run.smithi081.stdout:Install 13 Packages 2024-09-18T00:29:35.394 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:35.394 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 2.2 M 2024-09-18T00:29:35.394 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 26 M 2024-09-18T00:29:35.394 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repo Size 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 145 k 2024-09-18T00:29:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 435 k 2024-09-18T00:29:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:29:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 712 kB/s | 145 kB 00:00 2024-09-18T00:29:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:Total 706 kB/s | 145 kB 00:00 2024-09-18T00:29:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:29:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:29:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:29:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:29:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:29:35.864 INFO:teuthology.orchestra.run.smithi081.stdout:(1/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 294 kB/s | 49 kB 00:00 2024-09-18T00:29:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:29:35.937 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T00:29:35.962 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T00:29:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T00:29:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:36.214 INFO:teuthology.orchestra.run.smithi081.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 37 kB/s | 19 kB 00:00 2024-09-18T00:29:36.256 INFO:teuthology.orchestra.run.smithi081.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-18T00:29:36.714 INFO:teuthology.orchestra.run.smithi081.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 261 kB/s | 222 kB 00:00 2024-09-18T00:29:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T00:29:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:36.948 INFO:teuthology.orchestra.run.smithi081.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 216 kB/s | 159 kB 00:00 2024-09-18T00:29:37.029 INFO:teuthology.orchestra.run.smithi081.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 445 kB/s | 32 kB 00:00 2024-09-18T00:29:37.057 INFO:teuthology.orchestra.run.smithi081.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 515 kB/s | 14 kB 00:00 2024-09-18T00:29:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 5.2 MB/s | 220 kB 00:00 2024-09-18T00:29:37.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr 2024-09-18T00:29:37.207 INFO:teuthology.orchestra.run.smithi081.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 9.4 MB/s | 1.0 MB 00:00 2024-09-18T00:29:37.233 INFO:teuthology.orchestra.run.smithi081.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 285 kB/s | 279 kB 00:00 2024-09-18T00:29:37.258 INFO:teuthology.orchestra.run.smithi081.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-18T00:29:37.308 INFO:teuthology.orchestra.run.smithi081.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-18T00:29:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 86 kB/s | 54 kB 00:00 2024-09-18T00:29:37.345 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:37.345 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.1 MB/s | 2.2 MB 00:01 2024-09-18T00:29:37.416 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:37.433 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:37.433 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:37.524 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:37.525 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:00 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:37.862 INFO:teuthology.orchestra.run.smithi167.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:29:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:37.976 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T00:29:38.039 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:38.195 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T00:29:38.251 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T00:29:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T00:29:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T00:29:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T00:29:38.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T00:29:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:01 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T00:29:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T00:29:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:29:38.688 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:29:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:29:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:Install 12 Packages 2024-09-18T00:29:38.690 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 8.7 M 2024-09-18T00:29:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 104 M 2024-09-18T00:29:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:29:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:(1/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 107 kB/s | 16 kB 00:00 2024-09-18T00:29:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:(2/12): ceph-grafana-dashboards-19.1.1-330.gc2d 177 kB/s | 32 kB 00:00 2024-09-18T00:29:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-18T00:29:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:(4/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 9.6 MB/s | 3.6 MB 00:00 2024-09-18T00:29:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-09-18T00:29:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T00:29:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 448 kB/s | 19 kB 00:00 2024-09-18T00:29:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T00:29:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.3 MB/s | 548 kB 00:00 2024-09-18T00:29:39.426 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T00:29:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-18T00:29:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-18T00:29:39.474 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T00:29:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-18T00:29:39.496 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T00:29:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.8 MB/s | 863 kB 00:00 2024-09-18T00:29:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.6 MB/s | 2.0 MB 00:00 2024-09-18T00:29:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:Total 9.0 MB/s | 8.7 MB 00:00 2024-09-18T00:29:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:29:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:29:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:29:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:29:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T00:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-18T00:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T00:29:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T00:29:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T00:29:40.476 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:29:40.554 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T00:29:40.590 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T00:29:40.645 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T00:29:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T00:29:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:40.653 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:40.654 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:40.683 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T00:29:40.796 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T00:29:40.918 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T00:29:40.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T00:29:41.020 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T00:29:41.095 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T00:29:41.126 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T00:29:41.158 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-18T00:29:41.496 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:41.628 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T00:29:41.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:Install 6 Packages 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 7.0 M 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 33 M 2024-09-18T00:29:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:41.912 INFO:teuthology.orchestra.run.smithi081.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-18T00:29:41.936 INFO:teuthology.orchestra.run.smithi081.stdout:(2/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 668 kB/s | 146 kB 00:00 2024-09-18T00:29:41.987 INFO:teuthology.orchestra.run.smithi081.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-18T00:29:42.029 INFO:teuthology.orchestra.run.smithi081.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 1.8 MB/s | 74 kB 00:00 2024-09-18T00:29:42.079 INFO:teuthology.orchestra.run.smithi081.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.2 MB/s | 548 kB 00:00 2024-09-18T00:29:42.213 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-18T00:29:42.242 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T00:29:42.479 INFO:teuthology.orchestra.run.smithi081.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.8 MB/s | 6.0 MB 00:00 2024-09-18T00:29:42.482 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:42.482 INFO:teuthology.orchestra.run.smithi081.stdout:Total 8.2 MB/s | 7.0 MB 00:00 2024-09-18T00:29:42.553 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:42.565 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:42.565 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:42.662 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:42.664 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T00:29:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T00:29:43.687 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T00:29:43.687 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-18T00:29:43.687 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T00:29:43.688 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T00:29:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T00:29:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T00:29:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T00:29:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:44.000 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:44.001 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:44.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T00:29:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T00:29:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-18T00:29:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T00:29:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T00:29:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T00:29:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T00:29:44.865 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:07 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T00:29:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T00:29:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T00:29:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T00:29:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:44.904 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:45.001 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T00:29:45.002 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout:Install 12 Packages 2024-09-18T00:29:45.003 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:45.004 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 38 M 2024-09-18T00:29:45.004 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 212 M 2024-09-18T00:29:45.004 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:29:45.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-fuse 2024-09-18T00:29:45.563 INFO:teuthology.orchestra.run.smithi167.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-18T00:29:45.606 INFO:teuthology.orchestra.run.smithi167.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-18T00:29:45.732 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:45.856 INFO:teuthology.orchestra.run.smithi167.stdout:(3/12): ceph-mgr-diskprediction-local-19.1.1-33 16 MB/s | 7.4 MB 00:00 2024-09-18T00:29:45.864 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:45.864 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:45.865 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:Install 2 Packages 2024-09-18T00:29:45.866 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 977 k 2024-09-18T00:29:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 2.9 M 2024-09-18T00:29:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:46.206 INFO:teuthology.orchestra.run.smithi167.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 51 kB/s | 33 kB 00:00 2024-09-18T00:29:46.298 INFO:teuthology.orchestra.run.smithi081.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 520 kB/s | 80 kB 00:00 2024-09-18T00:29:46.381 INFO:teuthology.orchestra.run.smithi167.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 36 kB/s | 18 kB 00:00 2024-09-18T00:29:46.465 INFO:teuthology.orchestra.run.smithi081.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 2.7 MB/s | 897 kB 00:00 2024-09-18T00:29:46.465 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:46.465 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.6 MB/s | 977 kB 00:00 2024-09-18T00:29:46.477 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:46.499 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:46.499 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:46.579 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:46.579 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:46.806 INFO:teuthology.orchestra.run.smithi167.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-18T00:29:46.914 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T00:29:46.981 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T00:29:47.566 INFO:teuthology.orchestra.run.smithi167.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 323 kB/s | 245 kB 00:00 2024-09-18T00:29:47.677 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T00:29:47.677 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-18T00:29:47.707 INFO:teuthology.orchestra.run.smithi167.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 1.4 MB/s | 3.0 MB 00:02 2024-09-18T00:29:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T00:29:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:47.945 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T00:29:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:47.945 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:48.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-volume 2024-09-18T00:29:48.533 INFO:teuthology.orchestra.run.smithi167.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 304 kB/s | 250 kB 00:00 2024-09-18T00:29:48.794 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:48.930 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:48.931 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:29:48.932 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:48.932 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 285 k 2024-09-18T00:29:48.932 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 1.3 M 2024-09-18T00:29:48.932 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:49.161 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-18T00:29:49.161 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:49.162 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T00:29:49.162 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:49.170 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:49.170 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:49.194 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:49.195 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:49.413 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:49.487 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:29:49.487 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T00:29:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:50.058 INFO:teuthology.orchestra.run.smithi167.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 1.3 MB/s | 4.9 MB 00:03 2024-09-18T00:29:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:29:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:50.470 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:50.470 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:50.483 INFO:teuthology.orchestra.run.smithi167.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-09-18T00:29:50.567 INFO:teuthology.orchestra.run.smithi167.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.7 MB/s | 5.1 MB 00:03 2024-09-18T00:29:50.568 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:50.568 INFO:teuthology.orchestra.run.smithi167.stdout:Total 6.9 MB/s | 38 MB 00:05 2024-09-18T00:29:50.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librados-devel 2024-09-18T00:29:50.931 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:29:50.958 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:29:50.958 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:29:51.372 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:51.388 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:29:51.388 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:29:51.508 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:29:51.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 127 k 2024-09-18T00:29:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 456 k 2024-09-18T00:29:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:51.707 INFO:teuthology.orchestra.run.smithi081.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 642 kB/s | 127 kB 00:00 2024-09-18T00:29:51.708 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:51.708 INFO:teuthology.orchestra.run.smithi081.stdout:Total 637 kB/s | 127 kB 00:00 2024-09-18T00:29:51.708 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:51.714 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:51.714 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:51.778 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:51.778 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:52.046 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:29:52.157 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:29:52.227 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T00:29:52.265 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T00:29:52.367 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T00:29:52.408 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T00:29:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:29:52.594 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T00:29:52.623 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T00:29:52.701 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T00:29:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:29:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:52.802 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:52.802 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:53.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install libcephfs2 2024-09-18T00:29:53.364 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T00:29:53.480 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T00:29:53.641 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:53.731 INFO:teuthology.orchestra.run.smithi081.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:53.777 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:53.778 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:53.778 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:53.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install libcephfs-devel 2024-09-18T00:29:54.420 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:54.551 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:54.552 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:54.552 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-09-18T00:29:54.552 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:54.552 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 32 k 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 142 k 2024-09-18T00:29:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:29:54.694 INFO:teuthology.orchestra.run.smithi081.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 225 kB/s | 32 kB 00:00 2024-09-18T00:29:54.695 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:29:54.695 INFO:teuthology.orchestra.run.smithi081.stdout:Total 223 kB/s | 32 kB 00:00 2024-09-18T00:29:54.695 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:29:54.698 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:29:54.698 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:29:54.709 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:29:54.710 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:29:54.751 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T00:29:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:29:54.899 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:29:55.287 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:29:55.517 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:29:55.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:55.517 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:29:55.517 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:29:55.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:29:55.517 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:55.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librados2 2024-09-18T00:29:55.798 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T00:29:55.833 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T00:29:56.275 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:56.363 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:56.406 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:56.407 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:56.407 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:56.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install librbd1 2024-09-18T00:29:57.044 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:57.133 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:57.176 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:57.177 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:57.178 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:57.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rados 2024-09-18T00:29:57.824 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:57.911 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:58.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rgw 2024-09-18T00:29:58.468 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T00:29:58.468 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-18T00:29:58.468 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T00:29:58.469 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T00:29:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:58.689 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:58.732 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:58.733 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:58.733 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:58.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-cephfs 2024-09-18T00:29:58.935 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T00:29:58.935 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:58.935 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:29:58.935 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:29:58.935 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T00:29:58.936 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T00:29:58.937 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T00:29:58.937 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:29:58.937 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:29:59.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-rook 2024-09-18T00:29:59.380 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:29:59.470 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:29:59.513 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:29:59.514 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:29:59.514 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:29:59.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install python3-rbd 2024-09-18T00:29:59.958 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:00.091 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:00.092 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:00.092 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:30:00.092 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:00.092 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T00:30:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout:Install 13 Packages 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 2.2 M 2024-09-18T00:30:00.094 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 26 M 2024-09-18T00:30:00.095 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:00.156 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:30:00.244 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:00.287 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:30:00.288 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-18T00:30:00.288 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:30:00.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-fuse 2024-09-18T00:30:00.911 INFO:teuthology.orchestra.run.smithi167.stdout:(1/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 286 kB/s | 49 kB 00:00 2024-09-18T00:30:00.948 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:30:01.078 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:30:01.079 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:30:01.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 85 k 2024-09-18T00:30:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 231 k 2024-09-18T00:30:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:30:01.272 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 444 kB/s | 85 kB 00:00 2024-09-18T00:30:01.273 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:01.273 INFO:teuthology.orchestra.run.smithi081.stdout:Total 441 kB/s | 85 kB 00:00 2024-09-18T00:30:01.273 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:30:01.280 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:30:01.280 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:30:01.286 INFO:teuthology.orchestra.run.smithi167.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 35 kB/s | 19 kB 00:00 2024-09-18T00:30:01.312 INFO:teuthology.orchestra.run.smithi167.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-18T00:30:01.343 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:30:01.343 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:30:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:30:01.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:01.687 INFO:teuthology.orchestra.run.smithi167.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 286 kB/s | 222 kB 00:00 2024-09-18T00:30:01.958 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:02.029 INFO:teuthology.orchestra.run.smithi167.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 214 kB/s | 159 kB 00:00 2024-09-18T00:30:02.079 INFO:teuthology.orchestra.run.smithi167.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 650 kB/s | 32 kB 00:00 2024-09-18T00:30:02.105 INFO:teuthology.orchestra.run.smithi167.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 565 kB/s | 14 kB 00:00 2024-09-18T00:30:02.155 INFO:teuthology.orchestra.run.smithi167.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 331 kB/s | 279 kB 00:00 2024-09-18T00:30:02.181 INFO:teuthology.orchestra.run.smithi167.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 2.9 MB/s | 220 kB 00:00 2024-09-18T00:30:02.206 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:02.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:02.206 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:30:02.206 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:02.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:02.206 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:30:02.222 INFO:teuthology.orchestra.run.smithi167.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-18T00:30:02.264 INFO:teuthology.orchestra.run.smithi167.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-18T00:30:02.290 INFO:teuthology.orchestra.run.smithi167.stdout:(12/13): python3-requests-oauthlib-1.3.0-12.el9 89 kB/s | 54 kB 00:00 2024-09-18T00:30:02.390 INFO:teuthology.orchestra.run.smithi167.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.4 MB/s | 1.0 MB 00:00 2024-09-18T00:30:02.393 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:02.394 INFO:teuthology.orchestra.run.smithi167.stdout:Total 986 kB/s | 2.2 MB 00:02 2024-09-18T00:30:02.464 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:02.480 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:02.480 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:02.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-mirror 2024-09-18T00:30:02.572 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:02.572 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:03.075 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:03.106 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:44 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:30:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T00:30:03.249 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:30:03.249 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repo Size 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:30:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:03.251 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 3.1 M 2024-09-18T00:30:03.251 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 13 M 2024-09-18T00:30:03.251 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:30:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T00:30:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T00:30:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T00:30:03.459 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T00:30:03.560 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T00:30:03.585 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 9.3 MB/s | 3.1 MB 00:00 2024-09-18T00:30:03.586 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:03.587 INFO:teuthology.orchestra.run.smithi081.stdout:Total 9.3 MB/s | 3.1 MB 00:00 2024-09-18T00:30:03.587 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:30:03.595 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:30:03.595 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:30:03.671 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T00:30:03.679 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:30:03.680 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:30:03.728 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T00:30:04.108 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:30:04.177 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:04.204 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:04.204 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:30:04.204 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T00:30:04.205 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T00:30:04.205 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T00:30:04.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:04.444 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T00:30:04.500 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T00:30:04.534 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T00:30:04.582 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T00:30:04.604 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T00:30:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T00:30:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-18T00:30:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T00:30:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T00:30:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T00:30:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:05.376 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:30:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:05.377 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:30:05.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install rbd-nbd 2024-09-18T00:30:05.672 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T00:30:05.672 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:05.672 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:05.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:30:05.672 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T00:30:05.673 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T00:30:05.674 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:05.674 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:05.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T00:30:06.214 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Sep 2024 12:28:19 AM UTC. 2024-09-18T00:30:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-18T00:30:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Install 1 Package 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 170 k 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 494 k 2024-09-18T00:30:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-18T00:30:06.542 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:06.563 INFO:teuthology.orchestra.run.smithi081.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 797 kB/s | 170 kB 00:00 2024-09-18T00:30:06.564 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:06.565 INFO:teuthology.orchestra.run.smithi081.stdout:Total 792 kB/s | 170 kB 00:00 2024-09-18T00:30:06.565 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-18T00:30:06.572 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-18T00:30:06.572 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-18T00:30:06.637 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-18T00:30:06.637 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-18T00:30:06.677 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:06.678 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:06.679 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:30:06.679 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:06.679 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:06.679 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-18T00:30:06.679 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:30:06.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T00:30:06.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T00:30:06.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T00:30:06.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T00:30:06.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T00:30:06.680 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:06.681 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:06.681 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:06.681 INFO:teuthology.orchestra.run.smithi167.stdout:Install 6 Packages 2024-09-18T00:30:06.684 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:06.685 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 7.0 M 2024-09-18T00:30:06.686 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 33 M 2024-09-18T00:30:06.686 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-18T00:30:06.889 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:06.986 INFO:teuthology.orchestra.run.smithi167.stdout:(1/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 725 kB/s | 146 kB 00:00 2024-09-18T00:30:07.144 INFO:teuthology.orchestra.run.smithi167.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.4 MB/s | 548 kB 00:00 2024-09-18T00:30:07.178 INFO:teuthology.orchestra.run.smithi167.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-18T00:30:07.203 INFO:teuthology.orchestra.run.smithi167.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-18T00:30:07.355 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:07.612 INFO:teuthology.orchestra.run.smithi167.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 300 kB/s | 248 kB 00:00 2024-09-18T00:30:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:07.633 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-18T00:30:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:07.634 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-18T00:30:07.875 DEBUG:teuthology.parallel:result is None 2024-09-18T00:30:07.954 INFO:teuthology.orchestra.run.smithi167.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-18T00:30:07.956 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:07.956 INFO:teuthology.orchestra.run.smithi167.stdout:Total 5.5 MB/s | 7.0 MB 00:01 2024-09-18T00:30:08.026 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:08.038 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:08.039 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:08.139 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:08.140 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:08.447 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:08.614 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T00:30:08.663 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T00:30:09.184 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T00:30:09.277 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T00:30:09.339 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T00:30:09.385 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T00:30:10.176 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T00:30:10.177 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-18T00:30:10.177 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T00:30:10.177 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T00:30:10.177 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T00:30:10.177 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T00:30:10.438 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T00:30:10.438 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:10.438 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:10.438 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:30:10.438 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T00:30:10.439 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T00:30:10.439 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T00:30:10.439 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T00:30:10.439 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T00:30:10.439 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:10.439 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:10.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-fuse 2024-09-18T00:30:11.291 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:11.423 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:11.423 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:11.423 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:30:11.423 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout:Install 2 Packages 2024-09-18T00:30:11.424 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:11.425 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 977 k 2024-09-18T00:30:11.425 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 2.9 M 2024-09-18T00:30:11.425 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:11.982 INFO:teuthology.orchestra.run.smithi167.stdout:(1/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-18T00:30:12.340 INFO:teuthology.orchestra.run.smithi167.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 125 kB/s | 80 kB 00:00 2024-09-18T00:30:12.341 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:12.342 INFO:teuthology.orchestra.run.smithi167.stdout:Total 1.0 MB/s | 977 kB 00:00 2024-09-18T00:30:12.355 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:12.379 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:12.379 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:12.463 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:12.464 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:12.647 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:12.803 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T00:30:12.874 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T00:30:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T00:30:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-18T00:30:13.827 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T00:30:13.828 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:13.828 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:13.828 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T00:30:13.828 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:13.828 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:14.138 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-volume 2024-09-18T00:30:14.732 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:14.872 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:14.873 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:14.873 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-18T00:30:14.873 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:14.873 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:14.873 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 285 k 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 1.3 M 2024-09-18T00:30:14.874 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:15.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-18T00:30:15.115 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:15.115 INFO:teuthology.orchestra.run.smithi167.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T00:30:15.115 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:15.123 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:15.123 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:15.146 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:15.147 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:15.367 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:15.449 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:30:15.464 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:30:15.465 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:30:15.465 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T00:30:15.465 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:16.467 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T00:30:16.467 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:16.467 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:16.467 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T00:30:16.468 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:16.468 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:16.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install librados-devel 2024-09-18T00:30:17.397 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:17.533 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:17.534 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:17.534 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repo Size 2024-09-18T00:30:17.534 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:17.534 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 127 k 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 456 k 2024-09-18T00:30:17.535 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 605 kB/s | 127 kB 00:00 2024-09-18T00:30:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:Total 601 kB/s | 127 kB 00:00 2024-09-18T00:30:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:18.067 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:18.483 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:18.759 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:18.759 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:18.759 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:18.759 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:18.759 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:18.759 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:19.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install libcephfs2 2024-09-18T00:30:19.609 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:19.700 INFO:teuthology.orchestra.run.smithi167.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:19.745 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:19.746 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:19.746 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:19.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install libcephfs-devel 2024-09-18T00:30:20.401 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:20.533 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:20.534 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:20.534 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repo Size 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 32 k 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 142 k 2024-09-18T00:30:20.535 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:20.685 INFO:teuthology.orchestra.run.smithi167.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 212 kB/s | 32 kB 00:00 2024-09-18T00:30:20.685 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:20.686 INFO:teuthology.orchestra.run.smithi167.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-18T00:30:20.686 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:20.689 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:20.689 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:20.705 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:20.705 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:20.787 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:20.898 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:21.281 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:21.501 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:21.501 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:21.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install librados2 2024-09-18T00:30:22.282 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:45 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:22.371 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:22.417 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:22.418 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:22.419 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:22.492 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install librbd1 2024-09-18T00:30:23.070 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:46 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:23.160 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:23.204 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:23.205 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:23.205 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:23.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-rados 2024-09-18T00:30:23.864 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:46 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:23.954 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:23.997 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:23.998 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:23.998 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:24.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-rgw 2024-09-18T00:30:24.652 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:24.742 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:24.786 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:24.787 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:24.787 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:24.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-cephfs 2024-09-18T00:30:25.436 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:48 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:25.526 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:25.570 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:25.571 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:25.571 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:25.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-rbd 2024-09-18T00:30:26.227 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:49 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:26.315 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T00:30:26.358 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:26.359 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-18T00:30:26.359 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:26.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install rbd-fuse 2024-09-18T00:30:27.025 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:50 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:27.167 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:27.169 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:27.169 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-18T00:30:27.170 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:27.170 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:27.170 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-18T00:30:27.170 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:27.170 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:27.170 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:27.171 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:30:27.171 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:27.171 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 85 k 2024-09-18T00:30:27.171 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 231 k 2024-09-18T00:30:27.171 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:27.371 INFO:teuthology.orchestra.run.smithi167.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 422 kB/s | 85 kB 00:00 2024-09-18T00:30:27.372 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:27.373 INFO:teuthology.orchestra.run.smithi167.stdout:Total 418 kB/s | 85 kB 00:00 2024-09-18T00:30:27.373 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:27.380 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:27.380 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:27.448 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:27.448 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:27.607 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:27.713 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:28.144 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:28.398 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:28.399 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:28.399 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:28.399 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:28.399 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:28.399 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:28.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install rbd-mirror 2024-09-18T00:30:29.289 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:52 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:29.426 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repo Size 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:29.427 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:29.428 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:30:29.428 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:29.428 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 3.1 M 2024-09-18T00:30:29.428 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 13 M 2024-09-18T00:30:29.428 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:29.776 INFO:teuthology.orchestra.run.smithi167.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 8.9 MB/s | 3.1 MB 00:00 2024-09-18T00:30:29.776 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:29.777 INFO:teuthology.orchestra.run.smithi167.stdout:Total 8.9 MB/s | 3.1 MB 00:00 2024-09-18T00:30:29.777 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:29.786 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:29.786 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:29.869 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:29.869 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:30.298 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:30.368 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:30.395 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T00:30:30.395 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T00:30:30.395 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T00:30:30.395 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T00:30:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:31.577 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:31.578 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:31.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install rbd-nbd 2024-09-18T00:30:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:55 ago on Wed 18 Sep 2024 12:28:37 AM UTC. 2024-09-18T00:30:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-18T00:30:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:32.556 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-18T00:30:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-18T00:30:32.556 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 170 k 2024-09-18T00:30:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 494 k 2024-09-18T00:30:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-18T00:30:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 832 kB/s | 170 kB 00:00 2024-09-18T00:30:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-18T00:30:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:Total 825 kB/s | 170 kB 00:00 2024-09-18T00:30:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-18T00:30:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-18T00:30:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-18T00:30:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-18T00:30:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-18T00:30:32.989 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-18T00:30:33.093 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:33.527 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:33.768 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T00:30:33.768 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-18T00:30:33.768 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T00:30:33.768 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-18T00:30:34.046 DEBUG:teuthology.parallel:result is None 2024-09-18T00:30:34.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T00:30:34.191 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T00:30:34.216 INFO:teuthology.orchestra.run.smithi081.stdout:19.1.1-330.gc2ddf972.el9 2024-09-18T00:30:34.217 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-18T00:30:34.217 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-18T00:30:34.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T00:30:34.355 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T00:30:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:19.1.1-330.gc2ddf972.el9 2024-09-18T00:30:34.379 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-18T00:30:34.379 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-18T00:30:34.381 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T00:30:34.381 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:34.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T00:30:34.411 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:34.411 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T00:30:34.444 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T00:30:34.444 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:34.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T00:30:34.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T00:30:34.549 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:34.550 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T00:30:34.576 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T00:30:34.642 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T00:30:34.643 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:34.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T00:30:34.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T00:30:34.736 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:34.737 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T00:30:34.762 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T00:30:34.829 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T00:30:34.829 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:34.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T00:30:34.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T00:30:34.919 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:34.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T00:30:34.943 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T00:30:35.008 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T00:30:35.103 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T00:30:35.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-18T00:30:35.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-09-18T00:30:35.138 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T00:30:35.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T00:30:35.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T00:30:35.205 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T00:30:35.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T00:30:35.246 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T00:30:35.280 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T00:30:35.280 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writeback'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T00:30:35.280 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909651', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writeback'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1983, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '79/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6c/DLfu+Ybw7K9MoH8bC4kXW379TuBTEU4/HS81epgxhHL0PdYprXMigmNyIztuTdOgBmEqbia7jrHuyBbZUA=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2EZKWbcxjC3XMLj8XphdzU6iqbLTBySoSj/AcjlmZdgQuVP4Tr/953YovICI5h9HdK3qjzLCsLkXncsgfcQ0M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_21:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T00:30:35.281 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T00:30:35.311 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T00:30:35.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T00:30:35.365 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T00:30:35.391 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:35.391 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T00:30:35.445 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T00:30:35.445 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-18T00:30:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T00:30:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:35.501 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T00:30:35.501 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:35.501 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:35.502 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 00:30:04.463534690 +0000 2024-09-18T00:30:35.502 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 00:27:40.896531880 +0000 2024-09-18T00:30:35.502 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 00:27:40.896531880 +0000 2024-09-18T00:30:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 00:27:40.896531880 +0000 2024-09-18T00:30:35.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T00:30:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T00:30:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T00:30:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00020507 s, 2.5 MB/s 2024-09-18T00:30:35.566 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T00:30:35.622 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-18T00:30:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 00:30:04.463534690 +0000 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 00:27:41.219525944 +0000 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 00:27:41.219525944 +0000 2024-09-18T00:30:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 00:27:41.219525944 +0000 2024-09-18T00:30:35.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T00:30:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T00:30:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T00:30:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000244444 s, 2.1 MB/s 2024-09-18T00:30:35.742 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T00:30:35.797 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 00:30:04.463534690 +0000 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 00:27:41.559519696 +0000 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 00:27:41.559519696 +0000 2024-09-18T00:30:35.853 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 00:27:41.559519696 +0000 2024-09-18T00:30:35.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T00:30:35.916 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T00:30:35.916 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T00:30:35.916 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000210277 s, 2.4 MB/s 2024-09-18T00:30:35.917 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T00:30:35.973 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-18T00:30:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T00:30:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-18 00:30:04.464534671 +0000 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-18 00:27:41.887513668 +0000 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-18 00:27:41.887513668 +0000 2024-09-18T00:30:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-18 00:27:41.887513668 +0000 2024-09-18T00:30:36.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T00:30:36.092 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-18T00:30:36.092 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-18T00:30:36.092 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000216469 s, 2.4 MB/s 2024-09-18T00:30:36.093 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T00:30:36.149 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:36.149 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:36.149 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T00:30:36.167 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T00:30:36.167 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 00:30:30.665379447 +0000 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 00:27:38.043063625 +0000 2024-09-18T00:30:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 00:27:38.043063625 +0000 2024-09-18T00:30:36.225 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-18 00:27:38.043063625 +0000 2024-09-18T00:30:36.225 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T00:30:36.290 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T00:30:36.291 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T00:30:36.291 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000197075 s, 2.6 MB/s 2024-09-18T00:30:36.292 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T00:30:36.349 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 00:30:30.665379447 +0000 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 00:27:38.364058017 +0000 2024-09-18T00:30:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 00:27:38.364058017 +0000 2024-09-18T00:30:36.407 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-18 00:27:38.364058017 +0000 2024-09-18T00:30:36.407 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T00:30:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T00:30:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T00:30:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000178502 s, 2.9 MB/s 2024-09-18T00:30:36.473 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T00:30:36.529 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 00:30:30.665379447 +0000 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 00:27:38.691052303 +0000 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 00:27:38.691052303 +0000 2024-09-18T00:30:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-18 00:27:38.691052303 +0000 2024-09-18T00:30:36.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T00:30:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T00:30:36.651 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T00:30:36.651 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000204037 s, 2.5 MB/s 2024-09-18T00:30:36.652 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T00:30:36.709 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-18 00:30:30.666379429 +0000 2024-09-18T00:30:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-18 00:27:39.020046555 +0000 2024-09-18T00:30:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-18 00:27:39.020046555 +0000 2024-09-18T00:30:36.765 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-18 00:27:39.020046555 +0000 2024-09-18T00:30:36.765 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T00:30:36.828 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-18T00:30:36.828 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-18T00:30:36.828 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000202126 s, 2.5 MB/s 2024-09-18T00:30:36.829 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T00:30:36.885 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:36.886 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-18T00:30:36.886 INFO:tasks.ceph:Generating config... 2024-09-18T00:30:36.887 INFO:tasks.ceph:[client] rbd cache = True 2024-09-18T00:30:36.887 INFO:tasks.ceph:[client] rbd cache policy = writeback 2024-09-18T00:30:36.887 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-18T00:30:36.887 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-18T00:30:36.887 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-18T00:30:36.887 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T00:30:36.887 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T00:30:36.888 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T00:30:36.888 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T00:30:36.888 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T00:30:36.888 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T00:30:36.889 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T00:30:36.889 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-18T00:30:36.889 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T00:30:36.889 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-18T00:30:36.889 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T00:30:36.889 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-18T00:30:36.889 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T00:30:36.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T00:30:36.949 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T00:30:36.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T00:30:36.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T00:30:37.023 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.c', '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]'), ('mon.b', '172.21.15.167')] 2024-09-18T00:30:37.024 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.167', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache policy': 'writeback'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-18T00:30:37.024 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:37.025 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T00:30:37.080 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --addv c '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]' --add b 172.21.15.167 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 1111294f-f881-4427-a507-2f6f0939f89f 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 1111294f-f881-4427-a507-2f6f0939f89f 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-18T00:30:37.165289+0000 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T00:30:37.165289+0000 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-18T00:30:37.166 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-18T00:30:37.167 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-18T00:30:37.167 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] mon.c 2024-09-18T00:30:37.167 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-18T00:30:37.168 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T00:30:37.183 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1111294f-f881-4427-a507-2f6f0939f89f... 2024-09-18T00:30:37.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T00:30:37.225 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T00:30:37.265 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-18T00:30:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-18T00:30:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T00:30:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-18T00:30:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-18T00:30:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-18T00:30:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-18T00:30:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.167" 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon client directed command retry = 5 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on pool no app = False 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject socket failures = 5000 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 1111294f-f881-4427-a507-2f6f0939f89f 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-18T00:30:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-18T00:30:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression algorithm = zstd 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression mode = aggressive 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-18T00:30:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: osd blocked scrub grace period = 3600 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: osd max markdown count = 1000 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: osd shutdown pgref assert = True 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.272 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-18T00:30:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T00:30:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: rbd cache = True 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: rbd cache policy = writeback 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-18T00:30:37.275 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.276 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.277 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T00:30:37.278 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.167" 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: mon client directed command retry = 5 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on pool no app = False 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject socket failures = 5000 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 1111294f-f881-4427-a507-2f6f0939f89f 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-09-18T00:30:37.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.281 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore compression algorithm = zstd 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore compression mode = aggressive 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-09-18T00:30:37.282 INFO:teuthology.orchestra.run.smithi167.stdout: osd blocked scrub grace period = 3600 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: osd max markdown count = 1000 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: osd shutdown pgref assert = True 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T00:30:37.284 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-09-18T00:30:37.285 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T00:30:37.286 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T00:30:37.286 INFO:teuthology.orchestra.run.smithi167.stdout: rbd cache = True 2024-09-18T00:30:37.286 INFO:teuthology.orchestra.run.smithi167.stdout: rbd cache policy = writeback 2024-09-18T00:30:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-09-18T00:30:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-09-18T00:30:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-09-18T00:30:37.287 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T00:30:37.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T00:30:37.382 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T00:30:37.382 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:37.382 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T00:30:37.398 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:37.398 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T00:30:37.454 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:30:37.454 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:37.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T00:30:37.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T00:30:37.528 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:30:37.528 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:37.584 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:30:37.584 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:37.584 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T00:30:37.584 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T00:30:37.619 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:30:37.619 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:37.675 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T00:30:37.675 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T00:30:37.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-18T00:30:37.726 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-18T00:30:37.728 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T00:30:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T00:30:37.793 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T00:30:37.793 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T00:30:37.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T00:30:37.834 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T00:30:37.846 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T00:30:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-18T00:30:37.900 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T00:30:37.901 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-18T00:30:37.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T00:30:37.925 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:37.925 INFO:tasks.ceph:role: osd.0 2024-09-18T00:30:37.925 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:30:37.925 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T00:30:37.997 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:37.997 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:37.997 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:37.997 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:37.998 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:37.998 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:37.998 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:37.998 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:37.998 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:37.998 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:38.518 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-18T00:30:38.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-18T00:30:38.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T00:30:38.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T00:30:38.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T00:30:38.751 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:38.751 INFO:tasks.ceph:role: osd.1 2024-09-18T00:30:38.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:30:38.751 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T00:30:38.826 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:38.827 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:39.284 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-18T00:30:39.286 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-18T00:30:39.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-18T00:30:39.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T00:30:39.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T00:30:39.476 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:39.477 INFO:tasks.ceph:role: osd.2 2024-09-18T00:30:39.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:30:39.477 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T00:30:39.551 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:39.551 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:39.551 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:39.552 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:40.047 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-18T00:30:40.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-18T00:30:40.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-18T00:30:40.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T00:30:40.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T00:30:40.290 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:40.292 INFO:tasks.ceph:role: osd.3 2024-09-18T00:30:40.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:30:40.292 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:40.365 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:40.366 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:40.366 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:40.366 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:40.871 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-18T00:30:40.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-18T00:30:40.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-18T00:30:40.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T00:30:41.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:41.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:41.127+0000 7fb1bed1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T00:30:41.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:41.127+0000 7fb1bed1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T00:30:41.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:41.127+0000 7fb1bed1b640 -1 bdev(0x55fe4494b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-18T00:30:41.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:41.128+0000 7fb1bed1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T00:30:44.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T00:30:44.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:44.172+0000 7fa1cc120640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T00:30:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:44.173+0000 7fa1cc120640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T00:30:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:44.173+0000 7fa1cc120640 -1 bdev(0x55f0323f7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-18T00:30:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:44.173+0000 7fa1cc120640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T00:30:47.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T00:30:47.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:47.214+0000 7fb1e8a17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T00:30:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:47.214+0000 7fb1e8a17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T00:30:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:47.214+0000 7fb1e8a17640 -1 bdev(0x562f8cc39800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-18T00:30:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:47.214+0000 7fb1e8a17640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T00:30:50.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T00:30:50.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:50.764+0000 7f32a840b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T00:30:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:50.764+0000 7f32a840b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T00:30:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:50.764+0000 7f32a840b640 -1 bdev(0x5609e7c1d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-18T00:30:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:30:50.764+0000 7f32a840b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T00:30:53.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T00:30:53.701 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-18T00:30:53.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:53.733 INFO:tasks.ceph:role: osd.4 2024-09-18T00:30:53.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:30:53.733 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:53.810 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:53.811 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:53.811 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:54.292 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T00:30:54.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T00:30:54.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-18T00:30:54.436 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-18T00:30:54.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-18T00:30:54.541 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:54.542 INFO:tasks.ceph:role: osd.5 2024-09-18T00:30:54.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:30:54.542 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T00:30:54.616 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:54.617 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:55.077 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T00:30:55.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T00:30:55.079 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-18T00:30:55.160 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-18T00:30:55.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-18T00:30:55.296 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:55.296 INFO:tasks.ceph:role: osd.6 2024-09-18T00:30:55.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:30:55.296 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:55.368 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:55.868 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T00:30:55.869 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T00:30:55.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-18T00:30:56.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-18T00:30:56.033 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-18T00:30:56.098 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-18T00:30:56.099 INFO:tasks.ceph:role: osd.7 2024-09-18T00:30:56.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:30:56.099 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T00:30:56.171 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T00:30:56.172 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T00:30:56.172 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T00:30:56.690 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-18T00:30:56.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-18T00:30:56.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-18T00:30:56.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-18T00:30:56.863 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:56.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:56.962+0000 7f0e8361e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-18T00:30:56.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:56.963+0000 7f0e8361e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-18T00:30:56.965 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:56.963+0000 7f0e8361e640 -1 bdev(0x56402dfb9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-18T00:30:56.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:56.963+0000 7f0e8361e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-18T00:30:59.876 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T00:30:59.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:30:59.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:59.989+0000 7efca3211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-18T00:30:59.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:59.989+0000 7efca3211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-18T00:30:59.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:59.989+0000 7efca3211640 -1 bdev(0x555d38bd1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-18T00:30:59.991 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:30:59.989+0000 7efca3211640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-18T00:31:03.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T00:31:03.173 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:31:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:03.264+0000 7fdf19415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-18T00:31:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:03.265+0000 7fdf19415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-18T00:31:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:03.265+0000 7fdf19415640 -1 bdev(0x55f7939e1800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-18T00:31:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:03.265+0000 7fdf19415640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-18T00:31:06.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-18T00:31:06.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:31:06.294 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:06.293+0000 7f32fa40d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-18T00:31:06.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:06.293+0000 7f32fa40d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-18T00:31:06.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:06.293+0000 7f32fa40d640 -1 bdev(0x560af332b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-18T00:31:06.295 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-18T00:31:06.293+0000 7f32fa40d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-18T00:31:09.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-18T00:31:09.728 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T00:31:09.728 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:09.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-18T00:31:09.759 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:09.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T00:31:09.829 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:09.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T00:31:09.899 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:09.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T00:31:09.969 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:09.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T00:31:10.038 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:10.038 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T00:31:10.067 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:10.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-18T00:31:10.135 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:10.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-18T00:31:10.202 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:10.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-18T00:31:10.268 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:10.269 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-18T00:31:10.334 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:10.334 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T00:31:10.353 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:10.353 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-18T00:31:10.390 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T00:31:10.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T00:31:10.396 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T00:31:10.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-18T00:31:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtH+pmv2M8KxAAdShgAVftaoCcxDStm9fwhw== 2024-09-18T00:31:10.434 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAxH+pmFFqoBxAAAVu1/RgOXsKeK3bAXvq+Ew== 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0H+pmhwJdChAA8ddgUjEEheiMb1sJRVP5WQ== 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA3H+pmUFTPDBAAd4RxbzYaqfCW05WFhpiBUA== 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA6H+pmO52aLRAA2hyzz5vjuSNbygrAfExtxA== 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtH+pmNykZLxAAMaUFE9jDUZtMsl9nV6Hvdg== 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-18T00:31:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBAH+pmA1V/ORAAnwHwQ8nVvtgpoMVg+M6jlg== 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBDH+pm74AFOxAA2GUawbVuNhTmm339Kj5SCA== 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBHH+pmLaHXDxAAkuDKAyjWzO9+Na0mg6Nu7A== 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBKH+pmr0GFERAAT60FIkdC3deBj9XDaPSsJw== 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtH+pm3zOyMRAARNNIO2MMQimjNEm8s6qyuw== 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-18T00:31:10.436 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtH+pmmmLjNBAARcJgpFvGEMPG3Tf9T4hYiQ== 2024-09-18T00:31:10.454 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAtH+pmv2M8KxAAdShgAVftaoCcxDStm9fwhw== 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAxH+pmFFqoBxAAAVu1/RgOXsKeK3bAXvq+Ew== 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA0H+pmhwJdChAA8ddgUjEEheiMb1sJRVP5WQ== 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA3H+pmUFTPDBAAd4RxbzYaqfCW05WFhpiBUA== 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-09-18T00:31:10.455 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQA6H+pmO52aLRAA2hyzz5vjuSNbygrAfExtxA== 2024-09-18T00:31:10.456 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-09-18T00:31:10.456 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAtH+pmNykZLxAAMaUFE9jDUZtMsl9nV6Hvdg== 2024-09-18T00:31:10.456 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-09-18T00:31:10.456 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBAH+pmA1V/ORAAnwHwQ8nVvtgpoMVg+M6jlg== 2024-09-18T00:31:10.456 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-09-18T00:31:10.456 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBDH+pm74AFOxAA2GUawbVuNhTmm339Kj5SCA== 2024-09-18T00:31:10.457 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-09-18T00:31:10.457 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBHH+pmLaHXDxAAkuDKAyjWzO9+Na0mg6Nu7A== 2024-09-18T00:31:10.457 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-09-18T00:31:10.457 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBKH+pmr0GFERAAT60FIkdC3deBj9XDaPSsJw== 2024-09-18T00:31:10.457 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-09-18T00:31:10.458 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAtH+pm3zOyMRAARNNIO2MMQimjNEm8s6qyuw== 2024-09-18T00:31:10.458 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2024-09-18T00:31:10.458 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQAtH+pmmmLjNBAARcJgpFvGEMPG3Tf9T4hYiQ== 2024-09-18T00:31:10.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T00:31:10.480 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T00:31:10.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T00:31:10.767 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T00:31:10.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:10.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T00:31:11.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T00:31:11.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T00:31:11.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T00:31:11.086 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T00:31:11.139 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T00:31:11.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T00:31:11.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T00:31:11.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T00:31:11.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-18T00:31:11.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T00:31:11.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-18T00:31:11.469 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-18T00:31:11.494 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T00:31:11.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-18T00:31:11.614 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:31:11.616 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T00:31:11.670 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T00:31:11.670 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T00:31:11.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T00:31:11.672 INFO:tasks.ceph.mon.a:Started 2024-09-18T00:31:11.672 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-18T00:31:11.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-18T00:31:11.674 INFO:tasks.ceph.mon.c:Started 2024-09-18T00:31:11.675 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-18T00:31:11.675 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-18T00:31:11.712 INFO:tasks.ceph.mon.b:Started 2024-09-18T00:31:11.712 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T00:31:11.712 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-18T00:31:11.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-18T00:31:11.714 INFO:tasks.ceph.mgr.y:Started 2024-09-18T00:31:11.714 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T00:31:11.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T00:31:11.716 INFO:tasks.ceph.mgr.x:Started 2024-09-18T00:31:11.716 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T00:31:11.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T00:31:17.103 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.101+0000 7efc4831e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T00:31:17.128 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.126+0000 7fb09c72f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T00:31:17.144 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.143+0000 7efc4831e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T00:31:17.168 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.167+0000 7fb09c72f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T00:31:17.287 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.285+0000 7efc4831e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T00:31:17.310 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.308+0000 7fb09c72f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T00:31:17.337 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.335+0000 7efc4831e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T00:31:17.359 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.357+0000 7fb09c72f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T00:31:17.496 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.495+0000 7efc4831e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T00:31:17.524 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.523+0000 7fb09c72f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T00:31:17.604 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.603+0000 7efc4831e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T00:31:17.632 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.631+0000 7fb09c72f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T00:31:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-18T00:31:17.903 INFO:tasks.ceph:check_enable_crimson: False 2024-09-18T00:31:17.903 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T00:31:17.903 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:17.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T00:31:17.925 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.923+0000 7efc4831e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T00:31:17.928 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:17.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T00:31:17.972 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:17.971+0000 7fb09c72f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T00:31:17.976 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:17.975+0000 7efc4831e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T00:31:17.993 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:17.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T00:31:18.025 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:18.023+0000 7fb09c72f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T00:31:18.049 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-18T00:31:18.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T00:31:18.114 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:18.114 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-18T00:31:18.125 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:18.124+0000 7efc4831e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T00:31:18.139 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:18.139 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-18T00:31:18.180 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:18.178+0000 7fb09c72f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T00:31:18.205 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:18.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-18T00:31:18.270 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-18T00:31:18.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-18T00:31:18.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new f3f5415f-ac86-4dd6-8c50-5391b44b9c6b 0 2024-09-18T00:31:18.564 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-09-18T00:31:18.575 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 06a47ef1-1ae7-40a2-a998-daac122fc229 1 2024-09-18T00:31:18.779 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-18T00:31:18.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 653ab61a-1037-4190-8806-7042ef3d0586 2 2024-09-18T00:31:18.975 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-09-18T00:31:18.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f 3 2024-09-18T00:31:19.106 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.104+0000 7fb09c72f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T00:31:19.157 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.156+0000 7fb09c72f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T00:31:19.171 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-09-18T00:31:19.182 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 7000f249-35b4-4770-8452-8f31064ef1de 4 2024-09-18T00:31:19.224 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:19.222+0000 7efc4831e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T00:31:19.279 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:19.277+0000 7efc4831e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T00:31:19.367 INFO:teuthology.orchestra.run.smithi167.stdout:4 2024-09-18T00:31:19.378 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 755442b3-b418-409d-bd0a-376579eeb381 5 2024-09-18T00:31:19.522 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.520+0000 7fb09c72f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-18T00:31:19.601 INFO:teuthology.orchestra.run.smithi167.stdout:5 2024-09-18T00:31:19.607 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.605+0000 7fb09c72f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T00:31:19.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 6b406b2b-e850-41be-bce8-9f13d2921c60 6 2024-09-18T00:31:19.669 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:19.667+0000 7efc4831e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-18T00:31:19.712 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.710+0000 7fb09c72f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T00:31:19.758 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:19.756+0000 7efc4831e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T00:31:19.758 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.757+0000 7fb09c72f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T00:31:19.797 INFO:teuthology.orchestra.run.smithi167.stdout:6 2024-09-18T00:31:19.808 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 8bb8987f-d8e4-494e-82ce-e1203957c35f 7 2024-09-18T00:31:19.870 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.869+0000 7fb09c72f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-18T00:31:19.871 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:19.870+0000 7efc4831e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T00:31:19.921 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:19.920+0000 7efc4831e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T00:31:19.923 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.922+0000 7fb09c72f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T00:31:19.968 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:19.966+0000 7fb09c72f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T00:31:19.988 INFO:teuthology.orchestra.run.smithi167.stdout:7 2024-09-18T00:31:19.999 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T00:31:20.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T00:31:20.002 INFO:tasks.ceph.osd.0:Started 2024-09-18T00:31:20.003 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T00:31:20.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T00:31:20.005 INFO:tasks.ceph.osd.1:Started 2024-09-18T00:31:20.006 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T00:31:20.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T00:31:20.008 INFO:tasks.ceph.osd.2:Started 2024-09-18T00:31:20.009 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T00:31:20.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T00:31:20.012 INFO:tasks.ceph.osd.3:Started 2024-09-18T00:31:20.012 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-18T00:31:20.012 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-18T00:31:20.015 INFO:tasks.ceph.osd.4:Started 2024-09-18T00:31:20.015 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-18T00:31:20.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-18T00:31:20.019 INFO:tasks.ceph.osd.5:Started 2024-09-18T00:31:20.019 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-18T00:31:20.019 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-18T00:31:20.022 INFO:tasks.ceph.osd.6:Started 2024-09-18T00:31:20.022 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-18T00:31:20.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-18T00:31:20.025 INFO:tasks.ceph.osd.7:Started 2024-09-18T00:31:20.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T00:31:20.046 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.045+0000 7efc4831e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-18T00:31:20.117 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:20.115+0000 7fb09c72f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T00:31:20.125 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.123+0000 7efc4831e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T00:31:20.170 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.168+0000 7efc4831e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T00:31:20.170 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:20.168+0000 7fb09c72f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T00:31:20.214 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:20.215 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:31:19.984105+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:31:20.223 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:20.221+0000 7fb09c72f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T00:31:20.229 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T00:31:20.229 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T00:31:20.283 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.281+0000 7efc4831e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T00:31:20.291 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:20.289+0000 7fb09c72f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T00:31:20.332 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.330+0000 7efc4831e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T00:31:20.334 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:20.332+0000 7fb09c72f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T00:31:20.379 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:20.377+0000 7fb09c72f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T00:31:20.385 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.383+0000 7efc4831e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T00:31:20.456 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.454+0000 7efc4831e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T00:31:20.500 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.499+0000 7efc4831e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T00:31:20.544 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:20.542+0000 7efc4831e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T00:31:21.030 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:21.029+0000 7fb09c72f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T00:31:21.034 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T00:31:21.193 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-18T00:31:21.194 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:31:19.984105+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:31:21.203 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-18T00:31:21.206 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-18T00:31:21.204+0000 7efc4831e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T00:31:21.253 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:21.248+0000 7f082a3c5640 -1 Falling back to public interface 2024-09-18T00:31:21.464 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:21.462+0000 7f5d82217640 -1 Falling back to public interface 2024-09-18T00:31:21.487 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:21.485+0000 7f7468c15640 -1 Falling back to public interface 2024-09-18T00:31:21.495 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:21.493+0000 7fb34ce1e640 -1 Falling back to public interface 2024-09-18T00:31:21.495 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:21.493+0000 7f9d8bc0d640 -1 Falling back to public interface 2024-09-18T00:31:21.729 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:21.727+0000 7f623b717640 -1 Falling back to public interface 2024-09-18T00:31:21.733 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:21.731+0000 7fb5c73b0640 -1 Falling back to public interface 2024-09-18T00:31:21.748 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:21.746+0000 7f9f4c3ae640 -1 Falling back to public interface 2024-09-18T00:31:22.043 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:22.042+0000 7fb03c6e8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-18T00:31:22.044 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-18T00:31:22.042+0000 7fb03c6e8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-18T00:31:24.981 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:24.979+0000 7f5d82217640 -1 osd.0 0 log_to_monitors true 2024-09-18T00:31:25.093 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:25.091+0000 7f082a3c5640 -1 osd.6 0 log_to_monitors true 2024-09-18T00:31:25.323 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:25.321+0000 7f7468c15640 -1 osd.7 0 log_to_monitors true 2024-09-18T00:31:25.475 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:25.473+0000 7f623b717640 -1 osd.5 0 log_to_monitors true 2024-09-18T00:31:25.545 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:25.543+0000 7f9f4c3ae640 -1 osd.3 0 log_to_monitors true 2024-09-18T00:31:25.545 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:25.544+0000 7fb5c73b0640 -1 osd.4 0 log_to_monitors true 2024-09-18T00:31:25.834 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:25.832+0000 7fb34ce1e640 -1 osd.2 0 log_to_monitors true 2024-09-18T00:31:26.083 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:26.081+0000 7f9d8bc0d640 -1 osd.1 0 log_to_monitors true 2024-09-18T00:31:26.792 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:26.789+0000 7f5d7db06640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T00:31:26.808 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:26.806+0000 7f5d75926640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:27.894 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:27.891+0000 7fb34885e640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T00:31:27.902 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:27.900+0000 7f9f48b51640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T00:31:27.907 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:27.905+0000 7fb34067e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:27.918 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:27.916+0000 7f9f4015d640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:28.010 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T00:31:28.122 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:28.121+0000 7f7464506640 -1 osd.7 0 waiting for initial osdmap 2024-09-18T00:31:28.138 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:28.137+0000 7f745c326640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:28.175 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:28.173+0000 7fb5c3b53640 -1 osd.4 0 waiting for initial osdmap 2024-09-18T00:31:28.182 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:28.180+0000 7f6237eba640 -1 osd.5 0 waiting for initial osdmap 2024-09-18T00:31:28.183 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:28.182+0000 7fb5bb15f640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:28.193 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:28.192+0000 7f622f4c6640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:28.223 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:28.221+0000 7f0826354640 -1 osd.6 0 waiting for initial osdmap 2024-09-18T00:31:28.232 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:28.231+0000 7f081e174640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:28.336 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-18T00:31:28.336 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":14,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:31:28.054650+0000","last_up_change":"2024-09-18T00:31:28.054650+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:31:28.348 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-09-18T00:31:28.803 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:28.800+0000 7f9d87d32640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T00:31:28.813 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:28.811+0000 7f9d7f33e640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:31:35.155 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T00:31:35.435 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-18T00:31:35.435 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":17,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:31:31.077866+0000","last_up_change":"2024-09-18T00:31:29.069471+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T00:31:29.068996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6813","nonce":1726163291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6817","nonce":1726163291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6825","nonce":1726163291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6819","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6821","nonce":1726163291}]},"public_addr":"172.21.15.81:6813/1726163291","cluster_addr":"172.21.15.81:6817/1726163291","heartbeat_back_addr":"172.21.15.81:6825/1726163291","heartbeat_front_addr":"172.21.15.81:6821/1726163291","state":["exists","up"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6825","nonce":2008948201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6827","nonce":2008948201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6831","nonce":2008948201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6829","nonce":2008948201}]},"public_addr":"172.21.15.167:6825/2008948201","cluster_addr":"172.21.15.167:6827/2008948201","heartbeat_back_addr":"172.21.15.167:6831/2008948201","heartbeat_front_addr":"172.21.15.167:6829/2008948201","state":["exists","up"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6817","nonce":2331356901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6819","nonce":2331356901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6823","nonce":2331356901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6821","nonce":2331356901}]},"public_addr":"172.21.15.167:6817/2331356901","cluster_addr":"172.21.15.167:6819/2331356901","heartbeat_back_addr":"172.21.15.167:6823/2331356901","heartbeat_front_addr":"172.21.15.167:6821/2331356901","state":["exists","up"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6801","nonce":2657673991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6803","nonce":2657673991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6807","nonce":2657673991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6805","nonce":2657673991}]},"public_addr":"172.21.15.167:6801/2657673991","cluster_addr":"172.21.15.167:6803/2657673991","heartbeat_back_addr":"172.21.15.167:6807/2657673991","heartbeat_front_addr":"172.21.15.167:6805/2657673991","state":["exists","up"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6809","nonce":2652298701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6811","nonce":2652298701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6815","nonce":2652298701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6813","nonce":2652298701}]},"public_addr":"172.21.15.167:6809/2652298701","cluster_addr":"172.21.15.167:6811/2652298701","heartbeat_back_addr":"172.21.15.167:6815/2652298701","heartbeat_front_addr":"172.21.15.167:6813/2652298701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.022758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:27.126737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.574908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.569036+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.436338+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.050552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.299077+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:31:35.447 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-18T00:31:35.447 INFO:tasks.ceph:Creating RBD pool 2024-09-18T00:31:35.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T00:31:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2024-09-18T00:31:36.145 DEBUG:teuthology.orchestra.run.smithi081:> rbd --cluster ceph pool init rbd 2024-09-18T00:31:39.166 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T00:31:39.166 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T00:31:39.166 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T00:31:39.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T00:31:39.167 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T00:31:39.499 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:39.510 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3390839151},{"type":"v1","addr":"172.21.15.81:6801","nonce":3390839151}]},"active_addr":"172.21.15.81:6801/3390839151","active_change":"2024-09-18T00:31:21.031957+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3398842053}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3695216334}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1982282446}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":289613031}]}]} 2024-09-18T00:31:39.514 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T00:31:39.514 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T00:31:39.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T00:31:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:39.791 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:31:39.143290+0000","last_up_change":"2024-09-18T00:31:29.069471+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T00:31:29.068996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T00:31:35.737341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6813","nonce":1726163291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6817","nonce":1726163291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6825","nonce":1726163291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6819","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6821","nonce":1726163291}]},"public_addr":"172.21.15.81:6813/1726163291","cluster_addr":"172.21.15.81:6817/1726163291","heartbeat_back_addr":"172.21.15.81:6825/1726163291","heartbeat_front_addr":"172.21.15.81:6821/1726163291","state":["exists","up"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6825","nonce":2008948201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6827","nonce":2008948201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6831","nonce":2008948201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6829","nonce":2008948201}]},"public_addr":"172.21.15.167:6825/2008948201","cluster_addr":"172.21.15.167:6827/2008948201","heartbeat_back_addr":"172.21.15.167:6831/2008948201","heartbeat_front_addr":"172.21.15.167:6829/2008948201","state":["exists","up"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6817","nonce":2331356901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6819","nonce":2331356901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6823","nonce":2331356901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6821","nonce":2331356901}]},"public_addr":"172.21.15.167:6817/2331356901","cluster_addr":"172.21.15.167:6819/2331356901","heartbeat_back_addr":"172.21.15.167:6823/2331356901","heartbeat_front_addr":"172.21.15.167:6821/2331356901","state":["exists","up"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6801","nonce":2657673991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6803","nonce":2657673991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6807","nonce":2657673991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6805","nonce":2657673991}]},"public_addr":"172.21.15.167:6801/2657673991","cluster_addr":"172.21.15.167:6803/2657673991","heartbeat_back_addr":"172.21.15.167:6807/2657673991","heartbeat_front_addr":"172.21.15.167:6805/2657673991","state":["exists","up"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6809","nonce":2652298701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6811","nonce":2652298701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6815","nonce":2652298701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6813","nonce":2652298701}]},"public_addr":"172.21.15.167:6809/2652298701","cluster_addr":"172.21.15.167:6811/2652298701","heartbeat_back_addr":"172.21.15.167:6815/2652298701","heartbeat_front_addr":"172.21.15.167:6813/2652298701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.022758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:27.126737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.574908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.569036+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.436338+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.050552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.299077+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:31:39.803 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T00:31:39.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T00:31:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:40.082 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:31:39.143290+0000","last_up_change":"2024-09-18T00:31:29.069471+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T00:31:29.068996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T00:31:35.737341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6813","nonce":1726163291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6817","nonce":1726163291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6825","nonce":1726163291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6819","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6821","nonce":1726163291}]},"public_addr":"172.21.15.81:6813/1726163291","cluster_addr":"172.21.15.81:6817/1726163291","heartbeat_back_addr":"172.21.15.81:6825/1726163291","heartbeat_front_addr":"172.21.15.81:6821/1726163291","state":["exists","up"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6825","nonce":2008948201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6827","nonce":2008948201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6831","nonce":2008948201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6829","nonce":2008948201}]},"public_addr":"172.21.15.167:6825/2008948201","cluster_addr":"172.21.15.167:6827/2008948201","heartbeat_back_addr":"172.21.15.167:6831/2008948201","heartbeat_front_addr":"172.21.15.167:6829/2008948201","state":["exists","up"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6817","nonce":2331356901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6819","nonce":2331356901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6823","nonce":2331356901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2331356901},{"type":"v1","addr":"172.21.15.167:6821","nonce":2331356901}]},"public_addr":"172.21.15.167:6817/2331356901","cluster_addr":"172.21.15.167:6819/2331356901","heartbeat_back_addr":"172.21.15.167:6823/2331356901","heartbeat_front_addr":"172.21.15.167:6821/2331356901","state":["exists","up"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6801","nonce":2657673991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6803","nonce":2657673991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6807","nonce":2657673991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6805","nonce":2657673991}]},"public_addr":"172.21.15.167:6801/2657673991","cluster_addr":"172.21.15.167:6803/2657673991","heartbeat_back_addr":"172.21.15.167:6807/2657673991","heartbeat_front_addr":"172.21.15.167:6805/2657673991","state":["exists","up"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6809","nonce":2652298701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6811","nonce":2652298701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6815","nonce":2652298701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6813","nonce":2652298701}]},"public_addr":"172.21.15.167:6809/2652298701","cluster_addr":"172.21.15.167:6811/2652298701","heartbeat_back_addr":"172.21.15.167:6815/2652298701","heartbeat_front_addr":"172.21.15.167:6813/2652298701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.022758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:27.126737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.574908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.569036+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.436338+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.050552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.299077+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:31:40.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T00:31:40.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T00:31:40.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T00:31:40.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T00:31:40.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T00:31:40.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T00:31:40.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T00:31:40.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T00:31:40.330 INFO:teuthology.orchestra.run.smithi081.stdout:60129542149 2024-09-18T00:31:40.331 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:40.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T00:31:40.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T00:31:40.342 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:40.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T00:31:40.343 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-18T00:31:40.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T00:31:40.344 INFO:teuthology.orchestra.run.smithi081.stdout:64424509446 2024-09-18T00:31:40.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T00:31:40.345 INFO:teuthology.orchestra.run.smithi081.stdout:60129542149 2024-09-18T00:31:40.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T00:31:40.346 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:40.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T00:31:40.348 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:40.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T00:31:40.862 INFO:teuthology.orchestra.run.smithi081.stdout:64424509443 2024-09-18T00:31:40.877 INFO:teuthology.orchestra.run.smithi081.stdout:60129542147 2024-09-18T00:31:40.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.4 2024-09-18T00:31:40.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-09-18T00:31:40.924 INFO:teuthology.orchestra.run.smithi081.stdout:64424509444 2024-09-18T00:31:40.932 INFO:teuthology.orchestra.run.smithi081.stdout:64424509443 2024-09-18T00:31:40.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.5 2024-09-18T00:31:40.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-18T00:31:40.963 INFO:teuthology.orchestra.run.smithi081.stdout:60129542147 2024-09-18T00:31:40.969 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-18T00:31:40.972 INFO:teuthology.orchestra.run.smithi081.stdout:64424509443 2024-09-18T00:31:40.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.2 2024-09-18T00:31:40.984 INFO:teuthology.orchestra.run.smithi081.stdout:64424509443 2024-09-18T00:31:40.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-09-18T00:31:40.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-18T00:31:40.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-18T00:31:41.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T00:31:41.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T00:31:41.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T00:31:41.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T00:31:41.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T00:31:41.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T00:31:41.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T00:31:41.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T00:31:42.373 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:42.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.4 2024-09-18T00:31:42.394 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.452 INFO:teuthology.orchestra.run.smithi081.stdout:60129542149 2024-09-18T00:31:42.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-18T00:31:42.472 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.489 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:42.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-18T00:31:42.503 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.527 INFO:teuthology.orchestra.run.smithi081.stdout:60129542149 2024-09-18T00:31:42.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-18T00:31:42.540 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:42.540 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.547 INFO:teuthology.orchestra.run.smithi081.stdout:64424509446 2024-09-18T00:31:42.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-18T00:31:42.558 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-18T00:31:42.563 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.585 INFO:teuthology.orchestra.run.smithi081.stdout:64424509445 2024-09-18T00:31:42.594 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-18T00:31:42.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-18T00:31:42.602 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-18T00:31:42.610 DEBUG:teuthology.parallel:result is None 2024-09-18T00:31:42.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T00:31:42.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:31:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:42.923 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:31:42.935 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-18T00:31:41.760048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218032,"kb_used_data":1752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756688,"statfs":{"total":773094113280,"available":772870848512,"internally_reserved":0,"allocated":1794048,"data_stored":1751070,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.721327"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548951+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:31:39.548951+0000","last_peered":"2024-09-18T00:31:39.548951+0000","last_clean":"2024-09-18T00:31:39.548951+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:31:39.548951+0000","last_undegraded":"2024-09-18T00:31:39.548951+0000","last_fullsized":"2024-09-18T00:31:39.548951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155404+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:31:39.155404+0000","last_peered":"2024-09-18T00:31:39.155404+0000","last_clean":"2024-09-18T00:31:39.155404+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:31:39.155404+0000","last_undegraded":"2024-09-18T00:31:39.155404+0000","last_fullsized":"2024-09-18T00:31:39.155404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227597+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:31:39.227597+0000","last_peered":"2024-09-18T00:31:39.227597+0000","last_clean":"2024-09-18T00:31:39.227597+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:31:39.227597+0000","last_undegraded":"2024-09-18T00:31:39.227597+0000","last_fullsized":"2024-09-18T00:31:39.227597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155377+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:31:39.155377+0000","last_peered":"2024-09-18T00:31:39.155377+0000","last_clean":"2024-09-18T00:31:39.155377+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:31:39.155377+0000","last_undegraded":"2024-09-18T00:31:39.155377+0000","last_fullsized":"2024-09-18T00:31:39.155377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.160156+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:31:39.160156+0000","last_peered":"2024-09-18T00:31:39.160156+0000","last_clean":"2024-09-18T00:31:39.160156+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:31:39.160156+0000","last_undegraded":"2024-09-18T00:31:39.160156+0000","last_fullsized":"2024-09-18T00:31:39.160156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548804+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:31:39.548804+0000","last_peered":"2024-09-18T00:31:39.548804+0000","last_clean":"2024-09-18T00:31:39.548804+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:31:39.548804+0000","last_undegraded":"2024-09-18T00:31:39.548804+0000","last_fullsized":"2024-09-18T00:31:39.548804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227579+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:31:39.227579+0000","last_peered":"2024-09-18T00:31:39.227579+0000","last_clean":"2024-09-18T00:31:39.227579+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:31:39.227579+0000","last_undegraded":"2024-09-18T00:31:39.227579+0000","last_fullsized":"2024-09-18T00:31:39.227579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.158895+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:31:39.158895+0000","last_peered":"2024-09-18T00:31:39.158895+0000","last_clean":"2024-09-18T00:31:39.158895+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:31:39.158895+0000","last_undegraded":"2024-09-18T00:31:39.158895+0000","last_fullsized":"2024-09-18T00:31:39.158895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227114+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:31:39.227114+0000","last_peered":"2024-09-18T00:31:39.227114+0000","last_clean":"2024-09-18T00:31:39.227114+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:31:39.227114+0000","last_undegraded":"2024-09-18T00:31:39.227114+0000","last_fullsized":"2024-09-18T00:31:39.227114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:31:42.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:31:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:31:43.222 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-18T00:31:43.040013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218032,"kb_used_data":1752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756688,"statfs":{"total":773094113280,"available":772870848512,"internally_reserved":0,"allocated":1794048,"data_stored":1751070,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900536"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548951+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:31:39.548951+0000","last_peered":"2024-09-18T00:31:39.548951+0000","last_clean":"2024-09-18T00:31:39.548951+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:31:39.548951+0000","last_undegraded":"2024-09-18T00:31:39.548951+0000","last_fullsized":"2024-09-18T00:31:39.548951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155404+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:31:39.155404+0000","last_peered":"2024-09-18T00:31:39.155404+0000","last_clean":"2024-09-18T00:31:39.155404+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:31:39.155404+0000","last_undegraded":"2024-09-18T00:31:39.155404+0000","last_fullsized":"2024-09-18T00:31:39.155404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227597+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:31:39.227597+0000","last_peered":"2024-09-18T00:31:39.227597+0000","last_clean":"2024-09-18T00:31:39.227597+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:31:39.227597+0000","last_undegraded":"2024-09-18T00:31:39.227597+0000","last_fullsized":"2024-09-18T00:31:39.227597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155377+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:31:39.155377+0000","last_peered":"2024-09-18T00:31:39.155377+0000","last_clean":"2024-09-18T00:31:39.155377+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:31:39.155377+0000","last_undegraded":"2024-09-18T00:31:39.155377+0000","last_fullsized":"2024-09-18T00:31:39.155377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.160156+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:31:39.160156+0000","last_peered":"2024-09-18T00:31:39.160156+0000","last_clean":"2024-09-18T00:31:39.160156+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:31:39.160156+0000","last_undegraded":"2024-09-18T00:31:39.160156+0000","last_fullsized":"2024-09-18T00:31:39.160156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548804+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:31:39.548804+0000","last_peered":"2024-09-18T00:31:39.548804+0000","last_clean":"2024-09-18T00:31:39.548804+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:31:39.548804+0000","last_undegraded":"2024-09-18T00:31:39.548804+0000","last_fullsized":"2024-09-18T00:31:39.548804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227579+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:31:39.227579+0000","last_peered":"2024-09-18T00:31:39.227579+0000","last_clean":"2024-09-18T00:31:39.227579+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:31:39.227579+0000","last_undegraded":"2024-09-18T00:31:39.227579+0000","last_fullsized":"2024-09-18T00:31:39.227579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.158895+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:31:39.158895+0000","last_peered":"2024-09-18T00:31:39.158895+0000","last_clean":"2024-09-18T00:31:39.158895+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:31:39.158895+0000","last_undegraded":"2024-09-18T00:31:39.158895+0000","last_fullsized":"2024-09-18T00:31:39.158895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227114+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:31:39.227114+0000","last_peered":"2024-09-18T00:31:39.227114+0000","last_clean":"2024-09-18T00:31:39.227114+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:31:39.227114+0000","last_undegraded":"2024-09-18T00:31:39.227114+0000","last_fullsized":"2024-09-18T00:31:39.227114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:31:43.223 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T00:31:43.223 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T00:31:43.223 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T00:31:43.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T00:31:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:43.528 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T00:31:43.541 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T00:31:43.541 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-18T00:31:43.551 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-18T00:31:43.552 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writeback'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}} 2024-09-18T00:31:43.552 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-18T00:31:43.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-18T00:31:43.846 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-18T00:31:43.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T00:31:43.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:31:44.121 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:44.121 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:31:44.133 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-18T00:31:43.040013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218032,"kb_used_data":1752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756688,"statfs":{"total":773094113280,"available":772870848512,"internally_reserved":0,"allocated":1794048,"data_stored":1751070,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900536"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548951+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:31:39.548951+0000","last_peered":"2024-09-18T00:31:39.548951+0000","last_clean":"2024-09-18T00:31:39.548951+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:31:39.548951+0000","last_undegraded":"2024-09-18T00:31:39.548951+0000","last_fullsized":"2024-09-18T00:31:39.548951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155404+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:31:39.155404+0000","last_peered":"2024-09-18T00:31:39.155404+0000","last_clean":"2024-09-18T00:31:39.155404+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:31:39.155404+0000","last_undegraded":"2024-09-18T00:31:39.155404+0000","last_fullsized":"2024-09-18T00:31:39.155404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227597+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:31:39.227597+0000","last_peered":"2024-09-18T00:31:39.227597+0000","last_clean":"2024-09-18T00:31:39.227597+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:31:39.227597+0000","last_undegraded":"2024-09-18T00:31:39.227597+0000","last_fullsized":"2024-09-18T00:31:39.227597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155377+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:31:39.155377+0000","last_peered":"2024-09-18T00:31:39.155377+0000","last_clean":"2024-09-18T00:31:39.155377+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:31:39.155377+0000","last_undegraded":"2024-09-18T00:31:39.155377+0000","last_fullsized":"2024-09-18T00:31:39.155377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.160156+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:31:39.160156+0000","last_peered":"2024-09-18T00:31:39.160156+0000","last_clean":"2024-09-18T00:31:39.160156+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:31:39.160156+0000","last_undegraded":"2024-09-18T00:31:39.160156+0000","last_fullsized":"2024-09-18T00:31:39.160156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548804+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:31:39.548804+0000","last_peered":"2024-09-18T00:31:39.548804+0000","last_clean":"2024-09-18T00:31:39.548804+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:31:39.548804+0000","last_undegraded":"2024-09-18T00:31:39.548804+0000","last_fullsized":"2024-09-18T00:31:39.548804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227579+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:31:39.227579+0000","last_peered":"2024-09-18T00:31:39.227579+0000","last_clean":"2024-09-18T00:31:39.227579+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:31:39.227579+0000","last_undegraded":"2024-09-18T00:31:39.227579+0000","last_fullsized":"2024-09-18T00:31:39.227579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.158895+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:31:39.158895+0000","last_peered":"2024-09-18T00:31:39.158895+0000","last_clean":"2024-09-18T00:31:39.158895+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:31:39.158895+0000","last_undegraded":"2024-09-18T00:31:39.158895+0000","last_fullsized":"2024-09-18T00:31:39.158895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227114+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:31:39.227114+0000","last_peered":"2024-09-18T00:31:39.227114+0000","last_clean":"2024-09-18T00:31:39.227114+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:31:39.227114+0000","last_undegraded":"2024-09-18T00:31:39.227114+0000","last_fullsized":"2024-09-18T00:31:39.227114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:31:44.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:31:44.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:44.406 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:31:44.417 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-18T00:31:43.040013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218032,"kb_used_data":1752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756688,"statfs":{"total":773094113280,"available":772870848512,"internally_reserved":0,"allocated":1794048,"data_stored":1751070,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900536"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548951+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:31:39.548951+0000","last_peered":"2024-09-18T00:31:39.548951+0000","last_clean":"2024-09-18T00:31:39.548951+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:31:39.548951+0000","last_undegraded":"2024-09-18T00:31:39.548951+0000","last_fullsized":"2024-09-18T00:31:39.548951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155404+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:31:39.155404+0000","last_peered":"2024-09-18T00:31:39.155404+0000","last_clean":"2024-09-18T00:31:39.155404+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:31:39.155404+0000","last_undegraded":"2024-09-18T00:31:39.155404+0000","last_fullsized":"2024-09-18T00:31:39.155404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227597+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:31:39.227597+0000","last_peered":"2024-09-18T00:31:39.227597+0000","last_clean":"2024-09-18T00:31:39.227597+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:31:39.227597+0000","last_undegraded":"2024-09-18T00:31:39.227597+0000","last_fullsized":"2024-09-18T00:31:39.227597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.155377+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:31:39.155377+0000","last_peered":"2024-09-18T00:31:39.155377+0000","last_clean":"2024-09-18T00:31:39.155377+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:31:39.155377+0000","last_undegraded":"2024-09-18T00:31:39.155377+0000","last_fullsized":"2024-09-18T00:31:39.155377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.160156+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:31:39.160156+0000","last_peered":"2024-09-18T00:31:39.160156+0000","last_clean":"2024-09-18T00:31:39.160156+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:31:39.160156+0000","last_undegraded":"2024-09-18T00:31:39.160156+0000","last_fullsized":"2024-09-18T00:31:39.160156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.548804+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:31:39.548804+0000","last_peered":"2024-09-18T00:31:39.548804+0000","last_clean":"2024-09-18T00:31:39.548804+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:31:39.548804+0000","last_undegraded":"2024-09-18T00:31:39.548804+0000","last_fullsized":"2024-09-18T00:31:39.548804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227579+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:31:39.227579+0000","last_peered":"2024-09-18T00:31:39.227579+0000","last_clean":"2024-09-18T00:31:39.227579+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:31:39.227579+0000","last_undegraded":"2024-09-18T00:31:39.227579+0000","last_fullsized":"2024-09-18T00:31:39.227579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.158895+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:31:39.158895+0000","last_peered":"2024-09-18T00:31:39.158895+0000","last_clean":"2024-09-18T00:31:39.158895+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:31:39.158895+0000","last_undegraded":"2024-09-18T00:31:39.158895+0000","last_fullsized":"2024-09-18T00:31:39.158895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T00:31:39.227114+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:31:39.227114+0000","last_peered":"2024-09-18T00:31:39.227114+0000","last_clean":"2024-09-18T00:31:39.227114+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:31:39.227114+0000","last_undegraded":"2024-09-18T00:31:39.227114+0000","last_fullsized":"2024-09-18T00:31:39.227114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":661655,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:31:44.418 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T00:31:44.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 22 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 1111294f-f881-4427-a507-2f6f0939f89f 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-18T00:31:16.967705+0000 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-18T00:31:41.755694+0000 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 6 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-09-18T00:31:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client jewel 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release squid 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 8 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/2689107883,v1:172.21.15.81:6803/2689107883] [v2:172.21.15.81:6804/2689107883,v1:172.21.15.81:6805/2689107883] exists,up f3f5415f-ac86-4dd6-8c50-5391b44b9c6b 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6811/1726163291,v1:172.21.15.81:6813/1726163291] [v2:172.21.15.81:6815/1726163291,v1:172.21.15.81:6817/1726163291] exists,up 06a47ef1-1ae7-40a2-a998-daac122fc229 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/365910818,v1:172.21.15.81:6812/365910818] [v2:172.21.15.81:6814/365910818,v1:172.21.15.81:6816/365910818] exists,up 653ab61a-1037-4190-8806-7042ef3d0586 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/2780316581,v1:172.21.15.81:6827/2780316581] [v2:172.21.15.81:6828/2780316581,v1:172.21.15.81:6829/2780316581] exists,up b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/2008948201,v1:172.21.15.167:6825/2008948201] [v2:172.21.15.167:6826/2008948201,v1:172.21.15.167:6827/2008948201] exists,up 7000f249-35b4-4770-8452-8f31064ef1de 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/2331356901,v1:172.21.15.167:6817/2331356901] [v2:172.21.15.167:6818/2331356901,v1:172.21.15.167:6819/2331356901] exists,up 755442b3-b418-409d-bd0a-376579eeb381 2024-09-18T00:31:44.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/2657673991,v1:172.21.15.167:6801/2657673991] [v2:172.21.15.167:6802/2657673991,v1:172.21.15.167:6803/2657673991] exists,up 6b406b2b-e850-41be-bce8-9f13d2921c60 2024-09-18T00:31:44.697 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/2652298701,v1:172.21.15.167:6809/2652298701] [v2:172.21.15.167:6810/2652298701,v1:172.21.15.167:6811/2652298701] exists,up 8bb8987f-d8e4-494e-82ce-e1203957c35f 2024-09-18T00:31:44.707 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/2689107883,v1:172.21.15.81:6803/2689107883] [v2:172.21.15.81:6804/2689107883,v1:172.21.15.81:6805/2689107883] exists,up f3f5415f-ac86-4dd6-8c50-5391b44b9c6b', 'osd.1 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6811/1726163291,v1:172.21.15.81:6813/1726163291] [v2:172.21.15.81:6815/1726163291,v1:172.21.15.81:6817/1726163291] exists,up 06a47ef1-1ae7-40a2-a998-daac122fc229', 'osd.2 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/365910818,v1:172.21.15.81:6812/365910818] [v2:172.21.15.81:6814/365910818,v1:172.21.15.81:6816/365910818] exists,up 653ab61a-1037-4190-8806-7042ef3d0586', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/2780316581,v1:172.21.15.81:6827/2780316581] [v2:172.21.15.81:6828/2780316581,v1:172.21.15.81:6829/2780316581] exists,up b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f', 'osd.4 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/2008948201,v1:172.21.15.167:6825/2008948201] [v2:172.21.15.167:6826/2008948201,v1:172.21.15.167:6827/2008948201] exists,up 7000f249-35b4-4770-8452-8f31064ef1de', 'osd.5 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/2331356901,v1:172.21.15.167:6817/2331356901] [v2:172.21.15.167:6818/2331356901,v1:172.21.15.167:6819/2331356901] exists,up 755442b3-b418-409d-bd0a-376579eeb381', 'osd.6 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/2657673991,v1:172.21.15.167:6801/2657673991] [v2:172.21.15.167:6802/2657673991,v1:172.21.15.167:6803/2657673991] exists,up 6b406b2b-e850-41be-bce8-9f13d2921c60', 'osd.7 up in weight 1 up_from 15 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/2652298701,v1:172.21.15.167:6809/2652298701] [v2:172.21.15.167:6810/2652298701,v1:172.21.15.167:6811/2652298701] exists,up 8bb8987f-d8e4-494e-82ce-e1203957c35f'] 2024-09-18T00:31:44.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-18T00:31:44.806 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:44.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mon.a", 2024-09-18T00:31:44.806 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster": "ceph", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "admin_socket_mode": "", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_client_required": "cephx, none", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_cluster_required": "cephx", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_debug": "true", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_service_required": "cephx", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_supported": "cephx", 2024-09-18T00:31:44.807 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio": "true", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio_poll_ms": "250", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio_reap_max": "16", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_async_discard": "false", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_block_size": "4096", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_aio": "false", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_inflight_ios": "false", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_enable_discard": "false", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_flock_retry": "3", 2024-09-18T00:31:44.808 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_inject_crash": "0", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_ioring": "false", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_ioring_hipri": "false", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-18T00:31:44.809 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_type": "", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_alloc_size": "1048576", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_allocator": "hybrid", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_buffered_io": "true", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_check_for_zeros": "false", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_compact_log_sync": "false", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-18T00:31:44.810 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_max_log_runway": "4194304", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_max_prefetch": "1048576", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_min_flush_size": "524288", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_min_log_runway": "1048576", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_replay_recovery": "false", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_sync_write": "false", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_allocation_from_file": "true", 2024-09-18T00:31:44.811 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_allocator": "hybrid", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bdev_label_multi": "true", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_create": "true", 2024-09-18T00:31:44.812 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_db_create": "false", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_db_path": "", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_db_size": "0", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_path": "", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_preallocate_file": "false", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_size": "107374182400", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_wal_create": "false", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_wal_path": "", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_wal_size": "100663296", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs": "true", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-18T00:31:44.813 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_autotune": "true", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_size": "0", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-18T00:31:44.814 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_type": "2q", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_clone_cow": "true", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_mode": "none", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_csum_type": "crc32c", 2024-09-18T00:31:44.815 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_freelist": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-18T00:31:44.816 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_small_allocations": "0", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_default_buffered_read": "true", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_default_buffered_write": "false", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fail_eio": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mount": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_umount": "false", 2024-09-18T00:31:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_ignore_data_csum": "false", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-18T00:31:44.819 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_log_op_age": "5.000000", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_alloc_size": "0", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_blob_size": "0", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_deferred_txc": "32", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_min_alloc_size": "0", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_nid_prealloc": "1024", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-18T00:31:44.820 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_retry_disk_reads": "3", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_cf": "true", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-18T00:31:44.821 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_mem": "512", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_tracing": "false", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-18T00:31:44.822 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_zero_block_detection": "false", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-18T00:31:44.823 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_cluster_require_signatures": "false", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_cluster_require_version": "2", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_require_signatures": "false", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_require_version": "2", 2024-09-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_service_require_signatures": "false", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_service_require_version": "2", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_sign_messages": "true", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "chdir": "", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "client_acl_type": "", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "client_asio_thread_count": "2", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "client_cache_mid": "0.750000", 2024-09-18T00:31:44.825 INFO:teuthology.orchestra.run.smithi081.stdout: "client_cache_size": "16384", 2024-09-18T00:31:44.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_caps_release_delay": "5", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_check_pool_perm": "true", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_force_sync_read": "false", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_getattr_caps": "false", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_inject_features": "", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_inject_tick_delay": "0", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_die_on_failed_remount": "false", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_dirsize_rbytes": "true", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_force_lazyio": "false", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_fs": "", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-18T00:31:44.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_inject_release_failure": "false", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_max_inline_size": "4096", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mds_namespace": "", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_metadata": "", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mount_gid": "-1", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mount_timeout": "300", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mount_uid": "-1", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mountpoint": "/", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_notify_timeout": "10", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc": "true", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_max_dirty": "104857600", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-18T00:31:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_max_objects": "1000", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_size": "209715200", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_target_dirty": "8388608", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_permissions": "true", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_quota": "true", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_quota_df": "true", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_readahead_max_bytes": "0", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_readahead_max_periods": "4", 2024-09-18T00:31:44.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_readahead_min": "131072", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_reconnect_stale": "false", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_shutdown_timeout": "30", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_snapdir": ".snap", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_tick_interval": "1", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_trace": "", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_try_dentry_invalidate": "false", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_use_faked_inos": "false", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_use_random_mds": "false", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_graylog": "false", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_graylog_port": "12201", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_monitors": "default=true", 2024-09-18T00:31:44.832 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_syslog": "false", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_syslog_level": "info", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "-", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_network": "", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_network_interface": "", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zlib_isal": "false", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zlib_level": "5", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zlib_winsize": "-15", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zstd_level": "1", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_alien_op_num_threads": "6", 2024-09-18T00:31:44.833 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_osd_stat_interval": "0", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_seastar_cpu_cores": "", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_seastar_num_threads": "0", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location_hook": "", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location_hook_timeout": "10", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "daemonize": "false", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "daos_pool": "tank", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-18T00:31:44.834 INFO:teuthology.orchestra.run.smithi081.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_alienstore": "0/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_allow_any_pool_priority": "false", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_asok": "1/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_asok_assert_abort": "false", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_asserts_on_shutdown": "true", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_auth": "20/20", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_bdev": "1/3", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_bluefs": "1/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_bluestore": "1/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_buffer": "0/1", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_ceph_exporter": "1/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_cephfs_mirror": "0/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_cephsqlite": "0/5", 2024-09-18T00:31:44.835 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_client": "0/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_compressor": "1/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_context": "0/1", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_crimson_interrupt": "0/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_crush": "1/1", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_crypto": "1/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_cyanstore": "0/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_deliberately_leak_memory": "false", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_disable_randomized_ping": "false", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_dpdk": "1/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_eventtrace": "1/5", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_filer": "0/1", 2024-09-18T00:31:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_filestore": "1/3", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_finisher": "1/1", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_fuse": "1/5", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_heartbeat_testing_span": "0", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_heartbeatmap": "1/5", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_javaclient": "1/5", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_journal": "1/3", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_journaler": "0/5", 2024-09-18T00:31:44.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_kstore": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_lockdep": "0/1", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mclock": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_balancer": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_locker": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_log": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_log_expire": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_migrator": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_quiesce": "3/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_memstore": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mgr": "2/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mgrc": "1/5", 2024-09-18T00:31:44.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mon": "20/20", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_monc": "0/10", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_ms": "1/1", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_none": "0/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_objclass": "0/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_objectcacher": "0/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_objecter": "0/1", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_optracker": "0/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_osd": "1/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_paxos": "20/20", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_perfcounter": "1/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_prioritycache": "1/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rados": "0/5", 2024-09-18T00:31:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd": "0/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd_mirror": "0/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd_pwl": "0/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd_replay": "0/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_refs": "0/0", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_reserver": "1/1", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_access": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_datacache": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_dbstore": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_flight": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_sync": "1/5", 2024-09-18T00:31:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rocksdb": "4/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_backref": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_cache": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_cleaner": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_device": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_epm": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_journal": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_lba": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_odata": "0/5", 2024-09-18T00:31:44.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_omap": "0/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_onode": "0/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_t": "0/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_tm": "0/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_striper": "0/1", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_test": "0/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_throttle": "1/1", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_timer": "0/1", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_tp": "0/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_trace": "1/5", 2024-09-18T00:31:44.842 INFO:teuthology.orchestra.run.smithi081.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "device_failure_prediction_mode": "none", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_graylog": "false", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_journald": "false", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_stderr": "true", 2024-09-18T00:31:44.843 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_syslog": "false", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event_tracing": "false", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_addr": "0.0.0.0", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_http_port": "9926", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_prio_limit": "5", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_sort_metrics": "true", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_stats_period": "5", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "fake_statfs_for_testing": "0", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "fatal_signal_handlers": "true", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "filer_max_purge_ops": "10", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "filer_max_truncate_ops": "128", 2024-09-18T00:31:44.844 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_apply_finisher_threads": "1", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_blackhole": "false", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_btrfs_clone_range": "true", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_btrfs_snap": "true", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_caller_concurrency": "10", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_collect_device_partition_information": "true", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_commit_timeout": "600.000000", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_inject_read_err": "false", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_omap_check": "false", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_verify_split": "false", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_dump_file": "", 2024-09-18T00:31:44.845 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fadvise": "true", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fail_eio": "true", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fd_cache_shards": "16", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fd_cache_size": "128", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fiemap": "false", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fiemap_threshold": "4096", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-18T00:31:44.846 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_inject_stall": "0", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_journal_parallel": "false", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_journal_trailing": "false", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_journal_writeahead": "false", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_kill_at": "0", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs": "0", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-18T00:31:44.847 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size": "0", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_merge_threshold": "-10", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_odsync_write": "false", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_omap_backend": "rocksdb", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_omap_backend_path": "", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-18T00:31:44.848 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_op_thread_timeout": "60", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_op_threads": "2", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_punch_hole": "false", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-18T00:31:44.849 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_ops": "50", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_seek_data_hole": "false", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_sloppy_crc": "false", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_splice": "false", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_split_multiple": "2", 2024-09-18T00:31:44.850 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_split_rand_factor": "20", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_update_to": "1000", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_enable": "true", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-18T00:31:44.851 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_xfs_extsize": "false", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_zfs_snap": "false", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fio_dir": "/tmp/fio", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "1111294f-f881-4427-a507-2f6f0939f89f", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_allow_other": "true", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_atomic_o_trunc": "true", 2024-09-18T00:31:44.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_big_writes": "true", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_debug": "false", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_default_permissions": "false", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_disable_pagecache": "false", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_max_write": "0", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_multithreaded": "true", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_require_active_mds": "true", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_set_user_groups": "true", 2024-09-18T00:31:44.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_splice_move": "true", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_splice_read": "true", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_splice_write": "true", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_use_invalidate_cb": "true", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "gss_target_name": "ceph", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_file": "", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_inject_failure": "0", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_interval": "5", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "host": "smithi081", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-18T00:31:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "inject_early_sigterm": "false", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "jaeger_agent_port": "6799", 2024-09-18T00:31:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: "jaeger_tracing_enable": "false", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_aio": "true", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_align_min_size": "65536", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_block_align": "true", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_block_size": "4096", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_dio": "true", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_discard": "false", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_force_aio": "false", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_ignore_corruption": "false", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_max_write_bytes": "10485760", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_max_write_entries": "100", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_replay_from": "0", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-18T00:31:44.856 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_write_header_frequency": "0", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_zero_on_create": "false", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journaler_prefetch_periods": "10", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journaler_prezero_periods": "5", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "journaler_write_head_interval": "15", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "keyfile": "", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_backend": "rocksdb", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_default_stripe_size": "65536", 2024-09-18T00:31:44.857 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_fsck_on_mount": "false", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_max_bytes": "67108864", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_max_ops": "512", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_nid_prealloc": "1024", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_onode_map_size": "1024", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_sync_submit_transaction": "false", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_sync_transaction": "false", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "librados_thread_count": "2", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "lockdep": "false", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "lockdep_force_backtrace": "false", 2024-09-18T00:31:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: "log_coarse_timestamps": "true", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_flush_on_exit": "false", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_graylog_host": "127.0.0.1", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_graylog_port": "12201", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_max_new": "1000", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_max_recent": "10000", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_stderr_prefix": "", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_stop_at_utilization": "0.970000", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": "true", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_graylog": "false", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_journald": "false", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_stderr": "false", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_syslog": "false", 2024-09-18T00:31:44.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max_rotating_auth_attempts": "10", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_action_on_write_error": "1", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_alternate_name_max": "8192", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_asio_thread_count": "2", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_export_pin": "true", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_dirs": "true", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_interval": "5", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_interval": "10", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_max": "-1", 2024-09-18T00:31:44.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_max_until": "-1", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_merge_size": "50", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_midchunk": "0.300000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_min_start": "0.200000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_minchunk": "0.001000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_mode": "0", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_need_max": "1.200000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_need_min": "0.800000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_overload_epochs": "2", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_bits": "3", 2024-09-18T00:31:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_size": "10000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_target_decay": "10.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_beacon_grace": "15.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_beacon_interval": "4.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_mid": "0.700000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_quiesce_delay": "0", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-18T00:31:44.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_release_free_interval": "10", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_reservation": "0.050000", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_trim_interval": "1", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_trim_threshold": "262144", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_client_prealloc_inos": "1000", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_connect_bootstrapping": "false", 2024-09-18T00:31:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_damage_table_max_entries": "10000", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_auth_pins": "false", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_frag": "false", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_scatterstat": "false", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_subtrees": "false", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_decay_halflife": "5.000000", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_default_dir_hash": "2", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_defer_session_stale": "true", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_deny_all_reconnect": "false", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_keys_per_op": "16384", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_max_commit_size": "10", 2024-09-18T00:31:44.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_max_entries": "0", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_prefetch": "true", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_on_map": "false", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_early_reply": "true", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_enable_op_tracker": "true", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_enforce_unique_name": "true", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_random": "true", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-18T00:31:44.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_health_summarize_threshold": "10", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_health_dummy": "false", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_migrator_session_race": "false", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-18T00:31:44.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_join_fs": "", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_journal_format": "1", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_create_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_export_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_import_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_journal_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_journal_expire_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_journal_replay_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_link_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_mdstable_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_openc_at": "0", 2024-09-18T00:31:44.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_rename_at": "0", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_shutdown_at": "0", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_event_large_threshold": "524288", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_events_per_segment": "1024", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_max_events": "-1", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_max_segments": "128", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_pause": "false", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_segment_size": "0", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_trim_threshold": "128", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-18T00:31:44.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_warn_factor": "2.000000", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_caps_per_client": "1048576", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_completed_flushes": "100000", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_completed_requests": "100000", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_export_size": "20971520", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_file_recover": "32", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_purge_files": "64", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_purge_ops": "8192", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_snaps_per_dir": "100", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_metrics_update_interval": "2", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_min_caps_per_client": "100", 2024-09-18T00:31:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_min_caps_working_set": "10000", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_numa_node": "-1", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_complaint_time": "30.000000", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_duration": "600", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_size": "20", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_slow_op_size": "20", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_log_threshold": "5", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_ping_grace": "15", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_ping_interval": "5", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-18T00:31:44.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_max_caps": "30000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_warning_threshold": "262144", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_replay_interval": "1.000000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_root_ino_gid": "0", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_root_ino_uid": "0", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-18T00:31:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_shutdown_check": "0", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_skip_ino": "0", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_snap_max_uid": "4294967294", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_snap_min_uid": "0", 2024-09-18T00:31:44.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_snap_rstat": "false", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_standby_replay_damaged": "false", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_symlink_recovery": "true", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_thrash_exports": "0", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_thrash_fragments": "0", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_tick_interval": "5.000000", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_valgrind_exit": "false", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_verify_backtrace": "1", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_verify_scatter": "false", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_wipe_sessions": "false", 2024-09-18T00:31:44.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool_debug": "false", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_device_bytes": "1073741824", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_page_set": "false", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_page_size": "65536", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_client_bytes": "134217728", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_client_messages": "512", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-18T00:31:44.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_disabled_modules": "", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_enable_op_tracker": "true", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_max_pg_num_change": "128", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mds_bytes": "134217728", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mds_messages": "128", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mon_bytes": "134217728", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mon_messages": "128", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-18T00:31:44.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_op_history_duration": "600", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_op_history_size": "20", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_op_log_threshold": "5", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_osd_bytes": "536870912", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_osd_messages": "8192", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_pool": "true", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_standby_modules": "true", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_stats_period": "5", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_stats_threshold": "5", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_tick_period": "2", 2024-09-18T00:31:44.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_allow_pool_delete": "true", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_allow_pool_size_one": "true", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_auth_validate_all_caps": "true", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_bytes": "104857600", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_directed_command_retry": "5", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-18T00:31:44.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_parallel": "3", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_log_interval": "1.000000", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_ping_interval": "10.000000", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_target_rank": "-1", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_file_level": "debug", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_file": "true", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-18T00:31:44.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_journald": "false", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_compact_on_bootstrap": "false", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_compact_on_start": "false", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_compact_on_trim": "true", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cpu_threads": "4", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_crush_min_required_version": "hammer", 2024-09-18T00:31:44.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_daemon_bytes": "419430400", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data_avail_crit": "5", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data_avail_warn": "5", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data_size_warn": "16106127360", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_dump_json": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_dump_transactions": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_extra_checks": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-18T00:31:44.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_require_reef": "false", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_require_squid": "false", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_down_mkfs_grace": "120", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_down_uptime_grace": "60", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_election_default_strategy": "1", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_election_timeout": "5.000000", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_elector_ping_divisor": "2", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_enable_op_tracker": "true", 2024-09-18T00:31:44.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_fake_pool_delete": "false", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_force_quorum_join": "false", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_globalid_prealloc": "10000", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_detail_to_clog": "false", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_log_update_period": "5", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_max_detail": "50", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_to_clog": "true", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_to_clog_interval": "600", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_host": "172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.167", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_host_override": "", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_initial_members": "", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-18T00:31:44.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_lease": "5.000000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_log_full_interval": "50", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_log_max": "10000", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_log_max_summary": "50", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_log_epochs": "500", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-18T00:31:44.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_osd": "10000", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_pg_per_osd": "10000", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_pool_pg_num": "65536", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mds_force_trim_to": "0", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mds_skip_sanity": "false", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_memory_autotune": "true", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_memory_target": "2147483648", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_beacon_grace": "30", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_digest_period": "5", 2024-09-18T00:31:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_inactive_grace": "60", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_min_osdmap_epochs": "500", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_complaint_time": "30", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_duration": "600", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_size": "20", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_slow_op_size": "20", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_log_threshold": "5", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_auto_mark_in": "false", 2024-09-18T00:31:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_cache_size": "500", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_down_out_interval": "600", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_force_trim_to": "0", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-18T00:31:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_min_down_reporters": "2", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_report_timeout": "900", 2024-09-18T00:31:44.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_stuck_threshold": "60", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-18T00:31:44.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_probe_timeout": "2.000000", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_max_change": "0.050000", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_max_osds": "4", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_interval": "86400", 2024-09-18T00:31:44.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_max_keys": "100", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_timeout": "300", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_session_timeout": "300", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_smart_report_timeout": "5", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stat_smooth_intervals": "6", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_pool_min_size": "2", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_pool_size": "4", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_debug": "false", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-18T00:31:44.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_provider_kill_at": "0", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_requester_kill_at": "0", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_timeout": "60.000000", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_target_pg_per_osd": "100", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_tick_interval": "5", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_timecheck_interval": "300.000000", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_use_min_delay_socket": "false", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_older_version_delay": "604800", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-18T00:31:44.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_misplaced": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_older_version": "true", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-18T00:31:44.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": "", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_tracing_enabled": "false", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_op_threads": "3", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-18T00:31:44.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_cm": "false", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_device_name": "", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_dscp": "96", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_local_gid": "", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_port_num": "1", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_sl": "3", 2024-09-18T00:31:44.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_support_srq": "true", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_type": "ib", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_reap_threshold": "5", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_before_connect": "false", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_ipv4": "true", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_ipv6": "false", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_msgr1": "true", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_msgr2": "true", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_port_max": "7568", 2024-09-18T00:31:44.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_port_min": "6800", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_retry_count": "3", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_retry_delay": "5", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_client": "false", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_mds": "false", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_mgr": "false", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_mon": "false", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_osd": "false", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_client_mode": "crc secure", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_cluster_mode": "crc secure", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_cluster_type": "", 2024-09-18T00:31:44.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_compress_secure": "false", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_connection_idle_timeout": "900", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_connection_ready_timeout": "10", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_crc_data": "true", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_crc_header": "true", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_bad_msg": "false", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_bug": "true", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_old_message": "true", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_skipped_message": "false", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_coremask": "0xF", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-18T00:31:44.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_enable_tso": "true", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_hugepages": "", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_lro": "true", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_memory_channel": "4", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_pmd": "", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_port_id": "0", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dump_on_send": "false", 2024-09-18T00:31:44.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_initial_backoff": "0.200000", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_delay_max": "1.000000", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_delay_type": "", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_network_congestion": "0", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_socket_failures": "5000", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_learn_addr_from_peer": "true", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_max_accept_failures": "4", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_max_backoff": "15.000000", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_mon_client_mode": "secure crc", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_mon_service_mode": "secure crc", 2024-09-18T00:31:44.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_osd_compress_min_size": "1024", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_osd_compress_mode": "none", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_pq_min_cost": "65536", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_public_type": "", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_service_mode": "crc secure", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_listen_backlog": "512", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_nodelay": "true", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_rcvbuf": "0", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_type": "async+posix", 2024-09-18T00:31:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: "no_config_file": "false", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_completion_locks_per_session": "32", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_inflight_ops": "1024", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_tick_interval": "5.000000", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_timeout": "10.000000", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objectstore_blackhole": "false", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "openssl_engine_opts": "", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_delay_time": "5.000000", 2024-09-18T00:31:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_hist_halflife": "1000", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_max_low_ops": "2", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_max_ops": "4", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_slop": "0.020000", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_asio_thread_count": "2", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_async_recovery_min_cost": "100", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backfill_scan_max": "512", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backfill_scan_min": "64", 2024-09-18T00:31:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backoff_on_degraded": "false", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backoff_on_peering": "false", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backoff_on_unfound": "true", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_beacon_report_interval": "300", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_duration": "30", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_max_block_size": "67108864", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_blkin_trace_all": "false", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_check_for_log_corruption": "false", 2024-09-18T00:31:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_update_on_start": "true", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_message_cap": "256", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_message_size_cap": "524288000", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_op_priority": "63", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_watch_timeout": "30", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_command_max_records": "256", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_compact_on_start": "false", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-18T00:31:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_update_on_start": "true", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_update_weight_set": "true", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_feed_pullee": "-1", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-18T00:31:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_misdirected_ops": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_no_acting_change": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_no_purge_strays": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_op_order": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_shutdown": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_trim_objects": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-18T00:31:44.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_snaps": "false", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_keys": "1024", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_stride": "524288", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_default_notify_timeout": "30", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep": "0.000000", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-18T00:31:44.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_discard_disconnected_ops": "true", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_enable_op_tracker": "true", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_info": "true", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_shutdown": "true", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-18T00:31:44.908 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_function_tracing": "false", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_grace": "20", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_interval": "6", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_min_peers": "10", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_min_size": "2000", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_stale": "600", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_hit_set_max_size": "100000", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_hit_set_min_size": "1000", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-18T00:31:44.909 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_journal_size": "5120", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_kill_backfill_at": "0", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_cache_size": "50", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_dedup": "true", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_message_max": "40", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_share_max_epochs": "40", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_attr_name_len": "100", 2024-09-18T00:31:44.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_attr_size": "0", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_backfills": "1", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_markdown_count": "5", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_markdown_period": "600", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_object_name_len": "2048", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_object_namespace_len": "256", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_object_size": "134217728", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pg_blocked_by": "16", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pg_log_entries": "10000", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pgls": "1024", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_push_cost": "8388608", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_push_objects": "10", 2024-09-18T00:31:44.911 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_scrubs": "3", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_trimming_pgs": "2", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_write_op_reply_len": "64", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_write_size": "90", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_profile": "balanced", 2024-09-18T00:31:44.912 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_base": "805306368", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_cache_min": "134217728", 2024-09-18T00:31:44.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_target": "4294967296", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_target_autotune": "false", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_min_pg_log_entries": "250", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_min_recovery_priority": "0", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_report_interval": "5", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_num_cache_shards": "32", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_num_op_tracker_shard": "32", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_numa_auto_affinity": "true", 2024-09-18T00:31:44.914 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_numa_node": "-1", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_numa_prefer_iface": "true", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objecter_finishers": "1", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objectstore": "bluestore", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objectstore_fuse": "false", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objectstore_tracing": "false", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_complaint_time": "30.000000", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_duration": "600", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_size": "20", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_slow_op_size": "20", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_log_threshold": "5", 2024-09-18T00:31:44.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_shards": "0", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_shards_hdd": "5", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_shards_ssd": "8", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_pq_min_cost": "65536", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_queue_cut_off": "high", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_thread_timeout": "15", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_open_classes_on_start": "true", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_os_flags": "0", 2024-09-18T00:31:44.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_peering_op_priority": "255", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_delete_cost": "1048576", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_delete_priority": "5", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_log_trim_max": "10000", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_log_trim_min": "100", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-18T00:31:44.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_crimson": "false", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-18T00:31:44.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flags": "0", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_min_size": "0", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_pg_num": "32", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_pgp_num": "0", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_read_ratio": "70", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_size": "2", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_type": "replicated", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_push_per_object_cost": "1000", 2024-09-18T00:31:44.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recover_clone_overlap": "true", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_cost": "20971520", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_active": "0", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_single_start": "1", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_op_priority": "3", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-18T00:31:44.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_priority": "5", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep": "0.000000", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_repair_during_recovery": "false", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_requested_scrub_priority": "120", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_auto_repair": "false", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-18T00:31:44.921 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_begin_hour": "0", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_begin_week_day": "0", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_chunk_max": "25", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_chunk_min": "5", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_cost": "52428800", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_during_recovery": "false", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_end_hour": "0", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_end_week_day": "0", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_event_cost": "4096", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-18T00:31:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_invalid_stats": "true", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_max_preemptions": "5", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_priority": "5", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_sleep": "0.000000", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_skip_data_digest": "false", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_smart_report_timeout": "5", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_cost": "1048576", 2024-09-18T00:31:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_priority": "5", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_target_transaction_size": "30", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-18T00:31:44.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tracing": "false", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_use_stale_snap": "false", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osdc_blkin_trace_all": "false", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_kill_at": "0", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_max_join_drift": "10", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_min": "500", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_min_wait": "0.050000", 2024-09-18T00:31:44.925 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_propose_interval": "1.000000", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_service_trim_max": "500", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_service_trim_min": "250", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_stash_full_interval": "25", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_trim_max": "500", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_trim_min": "250", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "perf": "true", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "-", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrv": "", 2024-09-18T00:31:44.926 INFO:teuthology.orchestra.run.smithi081.stdout: "public_bind_addr": "-", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "public_network": "", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "public_network_interface": "", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "qat_compressor_busy_polling": "false", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "qat_compressor_enabled": "false", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "qat_compressor_session_max_number": "256", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rados_mon_op_timeout": "0", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rados_osd_op_timeout": "0", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rados_tracing": "false", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_atime_update_interval": "60", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_balance_parent_reads": "false", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_balance_snap_reads": "false", 2024-09-18T00:31:44.927 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_blkin_trace_all": "false", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache": "true", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_policy": "writearound", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_size": "33554432", 2024-09-18T00:31:44.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_clone_copy_on_read": "false", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_compression_hint": "none", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_concurrent_management_ops": "10", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_clone_format": "auto", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_data_pool": "", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_features": "61", 2024-09-18T00:31:44.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_format": "2", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_map_options": "", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_order": "22", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_pool": "rbd", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_stripe_count": "0", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_stripe_unit": "0", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_enable_alloc_hint": "true", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_io_scheduler": "simple", 2024-09-18T00:31:44.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_order": "24", 2024-09-18T00:31:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_pool": "", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_splay_width": "4", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_localize_parent_reads": "false", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_localize_snap_reads": "false", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-18T00:31:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-18T00:31:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mtime_update_interval": "60", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_non_blocking_aio": "true", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_op_thread_timeout": "60", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_op_threads": "1", 2024-09-18T00:31:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_parent_cache_enabled": "false", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_plugins": "", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_bps_burst": "0", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_bps_limit": "0", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_exclude_ops": "0", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_iops_burst": "0", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_iops_limit": "0", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-18T00:31:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-18T00:31:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_read_from_replica_policy": "default", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_skip_partial_discard": "true", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_tracing": "false", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_validate_names": "true", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_validate_pool": "true", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "restapi_base_url": "", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "restapi_log_level": "", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-18T00:31:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_acl_grants_max_num": "100", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_admin_entry": "admin", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_backend_store": "rados", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_barbican_url": "", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_beast_enable_async": "true", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_counters_cache": "false", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-18T00:31:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cache_enabled": "true", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cache_expiry_interval": "900", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cache_lru_size": "25000", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_config_store": "rados", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_content_length_compat": "false", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_copy_obj_progress": "true", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cors_rules_max_num": "100", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cross_domain_policy": "", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-18T00:31:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_addr": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_password": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_username": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_require_ssl": "true", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-18T00:31:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_addr": "", 2024-09-18T00:31:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_auth": "token", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_namespace": "", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_prefix": "", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_token_file": "", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_buffersize": "524288", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_low_speed_time": "300", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-18T00:31:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d4n_port": "6379", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_changes_size": "1000", 2024-09-18T00:31:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_num_shards": "128", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_window": "30", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-18T00:31:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-18T00:31:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dns_name": "", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dns_s3website_name": "", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dynamic_resharding": "true", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_gc_threads": "true", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_lc_threads": "true", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_ops_log": "false", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_quota_threads": "true", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_static_website": "false", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_usage_log": "false", 2024-09-18T00:31:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enforce_swift_acls": "true", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_exit_timeout_secs": "120", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_expose_bucket": "false", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_extended_http_attrs": "", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_filter": "none", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_frontends": "beast port=7480", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_deferred": "50", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_objs": "32", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-18T00:31:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_processor_period": "3600", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_init_timeout": "300", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_kafka_connection_idle": "300", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-18T00:31:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_domain": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_password": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_password_path": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_project": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_tenant": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_token": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_token_path": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_user": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_api_version": "2", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_domain": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_password": "", 2024-09-18T00:31:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_project": "", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_user": "", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_url": "", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_debug_interval": "-1", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_lock_max_time": "90", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_objs": "32", 2024-09-18T00:31:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_rules": "1000", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_worker": "3", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_thread_delay": "0", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_dnattr": "uid", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_searchfilter": "", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_uri": "", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_http_headers": "", 2024-09-18T00:31:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_object_name_utc": "false", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_attr_name_len": "0", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_attr_size": "0", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_chunk_size": "4194304", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_listing_results": "1000", 2024-09-18T00:31:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_notify_retries": "10", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_put_param_size": "1048576", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_put_size": "5368709120", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_slo_entries": "1000", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_md_log_max_shards": "64", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-18T00:31:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_mp_lock_max_time": "600", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_max_gc": "300", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-18T00:31:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_num_async_rados_threads": "32", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_num_control_oids": "8", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_numa_node": "-1", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_objexp_chunk_size": "100", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_objexp_gc_interval": "600", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-18T00:31:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_op_thread_timeout": "600", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_op_tracing": "false", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_opa_token": "", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_opa_url": "", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_opa_verify_ssl": "true", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_rados": "false", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_socket_path": "", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-18T00:31:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_push_interval": "2.000000", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_posix_cache_lanes": "3", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_posix_cache_partitions": "3", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_print_continue": "true", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-18T00:31:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rados_tracing": "false", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_realm": "", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_realm_id": "", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_region": "", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_request_uri": "", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_batch_size": "64", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-18T00:31:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_max_aio": "128", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_num_logs": "16", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_thread_interval": "600", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_resolve_cname": "false", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_run_sync_thread": "true", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-18T00:31:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_scheduler_type": "throttler", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_script_uri": "", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_service_provider_name": "", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_client_id": "", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_client_secret": "", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_entry": "sts", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_key": "sts", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_min_session_duration": "900", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_token_introspection_url": "", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_account_in_url": "false", 2024-09-18T00:31:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_auth_entry": "auth", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_auth_url": "", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_custom_header": "", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_need_stats": "true", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_tenant_name": "", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_token_expiration": "86400", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_url": "", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_url_prefix": "swift", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_lease_period": "120", 2024-09-18T00:31:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_thread_pool_size": "512", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-18T00:31:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_comment": "", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_createby": "", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_encoding": "", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_flag": "false", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_origin": "", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_tracker": "", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_trust_forwarded_https": "false", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_max_shards": "32", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_max_user_shards": "1", 2024-09-18T00:31:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_use_opa_authz": "false", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_counters_cache": "false", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_max_buckets": "1000", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_policies_max_num": "100", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_unique_email": "true", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_verify_ssl": "true", 2024-09-18T00:31:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zone": "", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zone_id": "", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zonegroup": "", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zonegroup_id": "", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgwlc_auto_session_clear": "true", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_block_size": "4096", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-18T00:31:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_size": "536870912", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_index_type": "binary_search", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-18T00:31:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_partition_filters": "false", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_perf": "false", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "run_dir": "/var/run/ceph", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_block_create": "true", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_cache_lru_size": "67108864", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_default_max_object_size": "16777216", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-18T00:31:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_device_size": "53687091200", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_full_integrity_check": "false", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_batch_capacity": "16", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_main_device_type": "SSD", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-18T00:31:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_segment_size": "67108864", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "set_keepcaps": "false", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "setgroup": "", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "setuser": "", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "setuser_match_path": "", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "thp": "false", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "threadpool_default_timeout": "60", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "throttler_perf_counter": "true" 2024-09-18T00:31:44.969 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:44.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-18T00:31:45.085 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a: {} 2024-09-18T00:31:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T00:31:45.094 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b: {} 2024-09-18T00:31:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T00:31:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c: {} 2024-09-18T00:31:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T00:31:45.114 DEBUG:teuthology.orchestra.run.smithi081:> type ceph-objectstore-tool 2024-09-18T00:31:45.128 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T00:31:45.128 DEBUG:teuthology.orchestra.run.smithi167:> type ceph-objectstore-tool 2024-09-18T00:31:45.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T00:31:45.147 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-18T00:31:45.159 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-18T00:31:45.159 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-18T00:31:45.160 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:31:45.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T00:31:45.160 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-18T00:31:45.161 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-18T00:31:45.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:31:45.161 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-18T00:31:45.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:31:45.161 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-18T00:31:45.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:31:45.162 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-18T00:31:45.188 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:45.186+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout:mapped writes DISABLED 2024-09-18T00:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout:mapped reads DISABLED 2024-09-18T00:31:45.204 INFO:teuthology.orchestra.run.smithi081.stdout:Seed set to 7876 2024-09-18T00:31:45.263 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:45.261+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:45.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:45.304 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:45.308 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:45.308 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:45.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:31:45.325 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:45.354 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:45.364 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:45.362+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:45.372 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:45.372 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:45.389 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:45.407 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:45.430 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:45.431 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:45.442 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:45.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:31:45.499 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:45.497+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:45.565 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:45.564+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:45.599 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:45.600 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:45.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:31:45.666 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:45.665+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:45.752 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:45.752 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:45.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:31:45.767 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:45.766+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:45.837 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:31:45.845 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T00:31:45.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T00:31:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:45.869 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:45.870 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:45.868+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:45.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:31:45.969 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:45.968+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:46.025 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.025 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:31:46.071 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:46.070+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:46.171 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:46.170+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:46.178 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.178 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:31:46.272 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:46.271+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:46.330 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.330 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:31:46.373 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:46.373+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:46.441 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.442 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:31:46.474 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:46.473+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:46.553 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.553 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:31:46.574 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:46.573+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:46.663 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.663 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:31:46.715 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:46.714+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:46.775 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.775 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.776 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:46.774+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:46.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:31:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T00:31:46.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T00:31:46.907 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:46.908 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:46.910 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:46.909+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:46.917 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:31:46.978 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:46.976+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:47.021 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:47.021 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:47.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:31:47.081 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:47.080+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:47.133 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:47.133 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:47.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:31:47.183 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:47.181+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:47.245 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:47.245 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:47.253 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:31:47.284 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:47.282+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:47.355 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:47.355 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:47.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:31:47.407 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:47.406+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:47.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:31:47.466 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:47.466 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:47.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:31:47.501 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:47.500+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:47.577 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:47.586 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:47.585+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:47.593 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:47.609 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:47.618 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:47.618 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:47.625 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:47.627 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:31:47.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:47.642 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:47.659 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:47.675 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:47.687 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:47.686+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:47.692 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:47.732 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:47.732 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:47.732 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:31:47.732 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:31:47.733 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:47.741 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:31:47.788 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:47.787+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:47.843 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:47.843 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:31:47.843 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:31:47.843 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [] 2024-09-18T00:31:47.843 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T00:31:47.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:31:47.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:31:47.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T00:31:47.902 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:47.901+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:47.955 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:47.955 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:47.956 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:31:47.956 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:47.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:31:47.989 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:47.988+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:48.066 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:48.066 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:48.066 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:31:48.066 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:31:48.066 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:48.074 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:31:48.118 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:48.116+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.083553+0000", 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 18.093266992, 2024-09-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.015862371, 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083553+0000", 2024-09-18T00:31:48.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083553+0000", 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083555+0000", 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6509999999999999e-06 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083564+0000", 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3340000000000008e-06 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083581+0000", 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7039999999999999e-05 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083596+0000", 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4578e-05 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083925+0000", 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000329084 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for peered", 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.083935+0000", 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.024e-05 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.097951+0000", 2024-09-18T00:31:48.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.014015534 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.098110+0000", 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00015877099999999999 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.098252+0000", 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014255 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.099109+0000", 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00085691000000000001 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.099347+0000", 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023809100000000001 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.099388+0000", 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0476999999999999e-05 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.099416+0000", 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8110999999999999e-05 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:33 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.187 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.134395+0000", 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 18.042425076000001, 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.007455532, 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 33 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134395+0000", 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134395+0000", 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134396+0000", 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7800000000000001e-07 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134400+0000", 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0419999999999996e-06 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134407+0000", 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0190000000000001e-06 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134411+0000", 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6729999999999998e-06 2024-09-18T00:31:48.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.136031+0000", 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00162027 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.136084+0000", 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3090000000000002e-05 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.136178+0000", 2024-09-18T00:31:48.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4234000000000006e-05 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.137874+0000", 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001695397 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.141761+0000", 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0038874669999999999 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.141813+0000", 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2040000000000003e-05 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.141851+0000", 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7722000000000002e-05 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.134417+0000", 2024-09-18T00:31:48.193 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 18.042403866000001, 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0075365789999999998, 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 34 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.194 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134417+0000", 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134417+0000", 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134417+0000", 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134419+0000", 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.367e-06 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134423+0000", 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.647e-06 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134426+0000", 2024-09-18T00:31:48.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7750000000000001e-06 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.136748+0000", 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0023224270000000002 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.136826+0000", 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8285e-05 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.136958+0000", 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000131722 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138778+0000", 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001820002 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.141890+0000", 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0031120929999999998 2024-09-18T00:31:48.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.141924+0000", 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4207e-05 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.141953+0000", 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8734e-05 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.134429+0000", 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 18.042391208000002, 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0076665240000000001, 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 35 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.200 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134429+0000", 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134429+0000", 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134429+0000", 2024-09-18T00:31:48.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.04e-07 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134462+0000", 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2691000000000003e-05 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134467+0000", 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.566e-06 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134470+0000", 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0680000000000001e-06 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.137258+0000", 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00278795 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.137339+0000", 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0934999999999997e-05 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.137473+0000", 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00013401299999999999 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138887+0000", 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001414626 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142005+0000", 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0031173590000000001 2024-09-18T00:31:48.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142055+0000", 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0711999999999998e-05 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142096+0000", 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0399999999999999e-05 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.134475+0000", 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 18.042345237999999, 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.007709207, 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 36 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.206 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134475+0000", 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134475+0000", 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134475+0000", 2024-09-18T00:31:48.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134479+0000", 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4699999999999998e-06 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134482+0000", 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4989999999999999e-06 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134485+0000", 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.988e-06 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.137913+0000", 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0034280170000000002 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.137971+0000", 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7803000000000002e-05 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138054+0000", 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3202999999999996e-05 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138892+0000", 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00083792600000000001 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142134+0000", 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.003241496 2024-09-18T00:31:48.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142163+0000", 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9003e-05 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142184+0000", 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1497000000000001e-05 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.134489+0000", 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 18.042330949, 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0099171480000000006, 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 37 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.212 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134489+0000", 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134489+0000", 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134490+0000", 2024-09-18T00:31:48.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6e-07 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134491+0000", 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.782e-06 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134495+0000", 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.343e-06 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.134498+0000", 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8849999999999999e-06 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138354+0000", 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0038565230000000002 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138435+0000", 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0617000000000004e-05 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.138562+0000", 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000126928 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.142107+0000", 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0035454330000000002 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.144314+0000", 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0022063429999999999 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.144368+0000", 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4601999999999997e-05 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.144407+0000", 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8432000000000001e-05 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327187+0000", 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849632918000001, 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0078390749999999992, 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.218 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 106 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327187+0000", 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327187+0000", 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327188+0000", 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5799999999999999e-07 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327304+0000", 2024-09-18T00:31:48.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011600200000000001 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327310+0000", 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5480000000000001e-06 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327318+0000", 2024-09-18T00:31:48.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9419999999999995e-06 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328065+0000", 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00074770399999999997 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328113+0000", 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8056999999999997e-05 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328194+0000", 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0834999999999994e-05 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329285+0000", 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001090796 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.334971+0000", 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0056855150000000004 2024-09-18T00:31:48.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335002+0000", 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1220999999999998e-05 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335027+0000", 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4797e-05 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327325+0000", 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849495010999998, 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0078432490000000001, 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 107 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.225 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327325+0000", 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327325+0000", 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327326+0000", 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1800000000000002e-07 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327328+0000", 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3379999999999999e-06 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327337+0000", 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4420000000000004e-06 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327341+0000", 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2930000000000001e-06 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328633+0000", 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001292425 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328712+0000", 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9151000000000002e-05 2024-09-18T00:31:48.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328834+0000", 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000121382 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332420+0000", 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.003586278 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335077+0000", 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.002657389 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335129+0000", 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1740000000000003e-05 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335169+0000", 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9493000000000003e-05 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327389+0000", 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849431263, 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0078602180000000004, 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 108 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327389+0000", 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327389+0000", 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327390+0000", 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327394+0000", 2024-09-18T00:31:48.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9879999999999998e-06 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327406+0000", 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2717e-05 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327411+0000", 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4499999999999997e-06 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329325+0000", 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001913973 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329375+0000", 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0494999999999997e-05 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329448+0000", 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3083999999999993e-05 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335180+0000", 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0057317039999999998 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335202+0000", 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.177e-05 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335228+0000", 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5950999999999999e-05 2024-09-18T00:31:48.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335249+0000", 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1613000000000001e-05 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327439+0000", 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849381173000001, 2024-09-18T00:31:48.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0097301249999999992, 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 109 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327439+0000", 2024-09-18T00:31:48.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327439+0000", 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327440+0000", 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1099999999999996e-07 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327520+0000", 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0728000000000004e-05 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327526+0000", 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6280000000000002e-06 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327530+0000", 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5820000000000002e-06 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329694+0000", 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0021641830000000001 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329770+0000", 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5820000000000003e-05 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.329895+0000", 2024-09-18T00:31:48.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000125666 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335297+0000", 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0054016910000000001 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337087+0000", 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001790247 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337132+0000", 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4666999999999998e-05 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337169+0000", 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7401999999999999e-05 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.243 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327546+0000", 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849274678, 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0097855349999999997, 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 110 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.244 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327546+0000", 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327546+0000", 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327546+0000", 2024-09-18T00:31:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327548+0000", 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3649999999999998e-06 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327554+0000", 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.31e-06 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327558+0000", 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1749999999999998e-06 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.331939+0000", 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0043806619999999996 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.331988+0000", 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9011000000000002e-05 2024-09-18T00:31:48.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332064+0000", 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6534999999999998e-05 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.336910+0000", 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0048460170000000002 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337255+0000", 2024-09-18T00:31:48.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000344925 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337296+0000", 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0549000000000001e-05 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337331+0000", 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5605000000000002e-05 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327562+0000", 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849257943000001, 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0098534720000000003, 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 111 2024-09-18T00:31:48.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327562+0000", 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327562+0000", 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327563+0000", 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.29e-07 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327565+0000", 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9420000000000002e-06 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327568+0000", 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4379999999999999e-06 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327571+0000", 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.762e-06 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332437+0000", 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0048666660000000004 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332480+0000", 2024-09-18T00:31:48.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2984e-05 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332568+0000", 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8018999999999999e-05 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.336943+0000", 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0043740200000000002 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337341+0000", 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00039825400000000001 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337383+0000", 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1906000000000002e-05 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337416+0000", 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3251999999999999e-05 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.255 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327575+0000", 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849245687, 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0099216960000000007, 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.256 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 112 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327575+0000", 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327575+0000", 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327575+0000", 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4799999999999999e-07 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327614+0000", 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8939000000000001e-05 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327619+0000", 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8160000000000001e-06 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327623+0000", 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7270000000000001e-06 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332802+0000", 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.005179009 2024-09-18T00:31:48.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.332884+0000", 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2787999999999994e-05 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.333011+0000", 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000126947 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.336979+0000", 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0039679700000000004 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337423+0000", 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00044404399999999999 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337464+0000", 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1097999999999999e-05 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337496+0000", 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.201e-05 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327628+0000", 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.849191957999999, 2024-09-18T00:31:48.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0099488440000000001, 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 113 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327628+0000", 2024-09-18T00:31:48.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327628+0000", 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327629+0000", 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9499999999999998e-07 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327632+0000", 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.937e-06 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327635+0000", 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.32e-06 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327638+0000", 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.706e-06 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.333447+0000", 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0058088489999999996 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.333521+0000", 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4231000000000001e-05 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.333641+0000", 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000119868 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337200+0000", 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0035590970000000002 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337504+0000", 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00030403 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337544+0000", 2024-09-18T00:31:48.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0639000000000002e-05 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337577+0000", 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2872e-05 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327642+0000", 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.84917823, 2024-09-18T00:31:48.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.010016334, 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 114 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327642+0000", 2024-09-18T00:31:48.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327642+0000", 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327642+0000", 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327644+0000", 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9130000000000001e-06 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327648+0000", 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2610000000000002e-06 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327650+0000", 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5849999999999998e-06 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.333933+0000", 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0062828490000000001 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.333984+0000", 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0555e-05 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.334067+0000", 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3755e-05 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337243+0000", 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0031758369999999999 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337585+0000", 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00034170199999999999 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337626+0000", 2024-09-18T00:31:48.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1489000000000002e-05 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337658+0000", 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2160999999999999e-05 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327862+0000", 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.848957933000001, 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.012027402, 2024-09-18T00:31:48.274 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 115 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327862+0000", 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327862+0000", 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327863+0000", 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6000000000000003e-07 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327944+0000", 2024-09-18T00:31:48.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0883000000000005e-05 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327956+0000", 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2259000000000001e-05 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327963+0000", 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.334337+0000", 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0063745980000000004 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.334446+0000", 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109171 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.334566+0000", 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011964900000000001 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337677+0000", 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0031113130000000001 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339807+0000", 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0021297830000000001 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339853+0000", 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5756e-05 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.279 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339890+0000", 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6971999999999998e-05 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327975+0000", 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.848845394000001, 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.011995822999999999, 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.280 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 116 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327975+0000", 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327975+0000", 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327976+0000", 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.06e-07 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327979+0000", 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.926e-06 2024-09-18T00:31:48.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327983+0000", 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3699999999999997e-06 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327986+0000", 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0089999999999999e-06 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335331+0000", 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0073455880000000001 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335379+0000", 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7237999999999997e-05 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335459+0000", 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9858999999999996e-05 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337719+0000", 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0022605390000000002 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339897+0000", 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.002178026 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339938+0000", 2024-09-18T00:31:48.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0754000000000003e-05 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339971+0000", 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2907999999999997e-05 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.286 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.327991+0000", 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.84882949, 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.012063814000000001, 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 117 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.287 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327991+0000", 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327991+0000", 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327991+0000", 2024-09-18T00:31:48.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8599999999999999e-07 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327995+0000", 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.478e-06 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.327998+0000", 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4359999999999998e-06 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.328001+0000", 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7839999999999999e-06 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335702+0000", 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0077011709999999997 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335779+0000", 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7109999999999999e-05 2024-09-18T00:31:48.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.335910+0000", 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000130481 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.337744+0000", 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001834336 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.339978+0000", 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0022338890000000002 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.340020+0000", 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2206000000000002e-05 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.340055+0000", 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4637000000000001e-05 2024-09-18T00:31:48.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.658242+0000", 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.518578547000001, 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00660539, 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.293 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 140 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658242+0000", 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658242+0000", 2024-09-18T00:31:48.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658242+0000", 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658278+0000", 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5469000000000002e-05 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658282+0000", 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.25e-06 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658286+0000", 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.335e-06 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.662985+0000", 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0046986119999999996 2024-09-18T00:31:48.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.663023+0000", 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8349000000000002e-05 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.663089+0000", 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5911e-05 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664270+0000", 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001180698 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664793+0000", 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00052301599999999995 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664817+0000", 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4439000000000001e-05 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664847+0000", 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.995e-05 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:30.658291+0000", 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 17.518529051000002, 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0066165399999999997, 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:48.299 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4172", 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/3695216334", 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 141 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658291+0000", 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:48.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658291+0000", 2024-09-18T00:31:48.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:48.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:48.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658292+0000", 2024-09-18T00:31:48.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7799999999999997e-07 2024-09-18T00:31:48.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658294+0000", 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.407e-06 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658297+0000", 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2279999999999998e-06 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.658300+0000", 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3750000000000001e-06 2024-09-18T00:31:48.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.663446+0000", 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0051465479999999999 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.663489+0000", 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2957999999999998e-05 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 0", 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.663575+0000", 2024-09-18T00:31:48.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6149999999999993e-05 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664526+0000", 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00095022499999999996 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664851+0000", 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000325927 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:48.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664874+0000", 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2455000000000001e-05 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:30.664908+0000", 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3989000000000003e-05 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:48.308 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:48.310 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:48.309+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:48.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:31:48.410 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:48.409+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:48.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:31:48.511 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:48.510+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:48.566 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:48.567 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:48.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:31:48.619 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:48.618+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:48.679 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:48.679 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.116485+0000", 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.560737189000001, 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037829389999999999, 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116485+0000", 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116485+0000", 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116486+0000", 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5499999999999998e-07 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116565+0000", 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9426999999999997e-05 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116573+0000", 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6340000000000001e-06 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116577+0000", 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.301e-06 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116617+0000", 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9567999999999998e-05 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116631+0000", 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4056999999999999e-05 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120226+0000", 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035950079999999998 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120268+0000", 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2388999999999997e-05 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.560272696999998, 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003338789, 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3000000000000001e-07 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116955+0000", 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116961+0000", 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.652e-06 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116965+0000", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5279999999999999e-06 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116999+0000", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4504e-05 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.117014+0000", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4533e-05 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120271+0000", 2024-09-18T00:31:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032572579999999999 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120288+0000", 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7028999999999999e-05 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.136279+0000", 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.540942910999998, 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050306079999999998, 2024-09-18T00:31:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136279+0000", 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136279+0000", 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136280+0000", 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136285+0000", 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8509999999999998e-06 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136291+0000", 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136295+0000", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4539999999999999e-06 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136328+0000", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3510000000000003e-05 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136341+0000", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2254e-05 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141265+0000", 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049247839999999998 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141310+0000", 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4520000000000001e-05 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.540164612000002, 2024-09-18T00:31:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042719469999999999, 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1999999999999999e-07 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137063+0000", 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.147e-06 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137075+0000", 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.165e-05 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137080+0000", 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137124+0000", 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4038000000000001e-05 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137136+0000", 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2359e-05 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141313+0000", 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041762709999999996 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141330+0000", 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6799e-05 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.539666540999999, 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037897730000000002, 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2300000000000002e-07 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137628+0000", 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2243999999999995e-05 2024-09-18T00:31:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137636+0000", 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4039999999999998e-06 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137640+0000", 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3869999999999997e-06 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137683+0000", 2024-09-18T00:31:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2759000000000002e-05 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137697+0000", 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4415e-05 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141330+0000", 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036330440000000002 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141345+0000", 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5097e-05 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'16)", 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.538591382, 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054426049999999997, 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6000000000000004e-07 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138637+0000", 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4360000000000001e-06 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138648+0000", 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.155e-05 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138654+0000", 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2560000000000002e-06 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138688+0000", 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3890000000000002e-05 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138699+0000", 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1413000000000001e-05 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.143993+0000", 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005294104 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.144073+0000", 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0395999999999994e-05 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.497467390000001, 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034774379999999998, 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0299999999999999e-07 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179811+0000", 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5195999999999998e-05 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179818+0000", 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8599999999999993e-06 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179824+0000", 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179856+0000", 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2051999999999997e-05 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179869+0000", 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2948e-05 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.183201+0000", 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003331643 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.183232+0000", 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1596e-05 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-18T00:31:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.328262+0000", 2024-09-18T00:31:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348959883999999, 2024-09-18T00:31:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057528869999999999, 2024-09-18T00:31:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328262+0000", 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328262+0000", 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328263+0000", 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328329+0000", 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6519999999999993e-05 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328337+0000", 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5039999999999996e-06 2024-09-18T00:31:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328341+0000", 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8750000000000002e-06 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328376+0000", 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5318000000000003e-05 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328389+0000", 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.275e-05 2024-09-18T00:31:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333990+0000", 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056012739999999998 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334015+0000", 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5236999999999999e-05 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348321300999999, 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051417349999999997, 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328911+0000", 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9189999999999994e-06 2024-09-18T00:31:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328917+0000", 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7400000000000001e-06 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328920+0000", 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1990000000000002e-06 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328951+0000", 2024-09-18T00:31:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0732000000000003e-05 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328962+0000", 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1362000000000001e-05 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334017+0000", 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050542429999999999 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334043+0000", 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6125000000000001e-05 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'65)", 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.329504+0000", 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.347717863, 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00456085, 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329504+0000", 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329504+0000", 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329505+0000", 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7700000000000005e-07 2024-09-18T00:31:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329510+0000", 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2789999999999998e-06 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329517+0000", 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6919999999999996e-06 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329521+0000", 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329553+0000", 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2410000000000003e-05 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329565+0000", 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2328e-05 2024-09-18T00:31:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334044+0000", 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044781919999999998 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334065+0000", 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1562000000000001e-05 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'65)", 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.347255681, 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041219459999999996, 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330034+0000", 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6576999999999996e-05 2024-09-18T00:31:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330040+0000", 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3609999999999997e-06 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330043+0000", 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1489999999999998e-06 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330075+0000", 2024-09-18T00:31:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2128999999999997e-05 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330086+0000", 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.115e-05 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334068+0000", 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039811810000000003 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334088+0000", 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0981000000000001e-05 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'65)", 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.332141+0000", 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.345081168, 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045817569999999997, 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332141+0000", 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332141+0000", 2024-09-18T00:31:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332142+0000", 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.13e-06 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332150+0000", 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1340000000000004e-06 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332169+0000", 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8938999999999999e-05 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332180+0000", 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.048e-05 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332282+0000", 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010231800000000001 2024-09-18T00:31:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332315+0000", 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2539999999999997e-05 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336697+0000", 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043823730000000002 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336723+0000", 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5843e-05 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'66)", 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.332624+0000", 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.34459816, 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041224620000000003, 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332624+0000", 2024-09-18T00:31:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332624+0000", 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332625+0000", 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332630+0000", 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4399999999999996e-06 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332637+0000", 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0589999999999997e-06 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332641+0000", 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7390000000000001e-06 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332677+0000", 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5855999999999997e-05 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332690+0000", 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3008e-05 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336725+0000", 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004035014 2024-09-18T00:31:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336747+0000", 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1866999999999999e-05 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'66)", 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.333103+0000", 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.344118737999999, 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036652360000000001, 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333103+0000", 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333103+0000", 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333104+0000", 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.37e-07 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333201+0000", 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6475e-05 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333217+0000", 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6439e-05 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333228+0000", 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0706999999999999e-05 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333308+0000", 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333340+0000", 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1949000000000002e-05 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336748+0000", 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00340735 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336769+0000", 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1209999999999999e-05 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'66)", 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.333732+0000", 2024-09-18T00:31:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.343490656, 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003334035, 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333732+0000", 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333732+0000", 2024-09-18T00:31:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333732+0000", 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7899999999999998e-07 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333747+0000", 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4827999999999999e-05 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333755+0000", 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1329999999999999e-06 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333760+0000", 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4179999999999999e-06 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333798+0000", 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8445999999999997e-05 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333810+0000", 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1640999999999999e-05 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.337044+0000", 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003234584 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.337066+0000", 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1305999999999999e-05 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:146 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'104, mlcod=16'102)", 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.006880370000001, 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049876579999999998, 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000005e-07 2024-09-18T00:31:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670349+0000", 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2009999999999996e-06 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670358+0000", 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7899999999999994e-06 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670363+0000", 2024-09-18T00:31:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4410000000000003e-06 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670446+0000", 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2968999999999998e-05 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670458+0000", 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2388000000000001e-05 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.675252+0000", 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047935549999999997 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.675330+0000", 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7688999999999994e-05 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:154 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'108, mlcod=16'105)", 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.556002509999999, 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037158859999999998, 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121229+0000", 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5690000000000005e-06 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121235+0000", 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2809999999999997e-06 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121238+0000", 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2789999999999999e-06 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121275+0000", 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6644999999999999e-05 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121286+0000", 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0750999999999999e-05 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124908+0000", 2024-09-18T00:31:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036223549999999998 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124936+0000", 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7585000000000001e-05 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:155 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'109, mlcod=16'105)", 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.555639397, 2024-09-18T00:31:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035924899999999998, 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121690+0000", 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106612 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121697+0000", 2024-09-18T00:31:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9469999999999997e-06 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121700+0000", 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3100000000000001e-06 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121732+0000", 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2051999999999997e-05 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121743+0000", 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0613e-05 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125152+0000", 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034096109999999999 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125175+0000", 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2926e-05 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:156 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'110, mlcod=16'105)", 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.555176487000001, 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033846810000000001, 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2899999999999999e-07 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122052+0000", 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8830000000000003e-06 2024-09-18T00:31:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122058+0000", 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.728e-06 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122061+0000", 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1190000000000001e-06 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124221+0000", 2024-09-18T00:31:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021602040000000002 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124234+0000", 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3151e-05 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125408+0000", 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011735059999999999 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125430+0000", 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2660999999999999e-05 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:161 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'115, mlcod=16'112)", 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.549357656000002, 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003404453, 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127936+0000", 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1049000000000004e-05 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127942+0000", 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127951+0000", 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2630000000000003e-06 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127985+0000", 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4872000000000001e-05 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127998+0000", 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2646000000000001e-05 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.131238+0000", 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032397839999999999 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.131269+0000", 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1194e-05 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:48.770 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:48.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:31:48.772 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:48.770+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:31:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T00:31:48.873 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:48.871+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:48.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T00:31:48.925 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:48.926 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:48.926 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:48.926 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:48.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:31:48.976 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:48.975+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:49.075 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:49.073+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:49.120 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:49.121 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:49.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:31:49.215 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:49.213+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4281.0:5 2.2 e20/18 2:5cea7035:::rbd_info:head v 20'1, mlcod=0'0)", 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:38.144503+0000", 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 11.13013246, 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000934631, 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144503+0000", 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144503+0000", 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144504+0000", 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.03e-07 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144511+0000", 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5089999999999996e-06 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144535+0000", 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.37e-05 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144550+0000", 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5208000000000001e-05 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144613+0000", 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3047999999999997e-05 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.144637+0000", 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4082000000000001e-05 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.145396+0000", 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000758276 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:38.145438+0000", 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2505e-05 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4281.0:7 2.2 e21/18 2:5cea7035:::rbd_info:head v 21'2, mlcod=0'0)", 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:39.159040+0000", 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 10.115596155, 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000945166, 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159040+0000", 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159040+0000", 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159040+0000", 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7500000000000001e-07 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159051+0000", 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1121000000000001e-05 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159075+0000", 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3654000000000001e-05 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159090+0000", 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5590000000000002e-05 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159142+0000", 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1125000000000003e-05 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159159+0000", 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7303e-05 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159945+0000", 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00078584100000000001 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:39.159985+0000", 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0256999999999998e-05 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:7 3.1a e25/23 3:5cea7035:::rbd_info:head v 25'1, mlcod=0'0)", 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:47.856573+0000", 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.4180626670000001, 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00082012199999999995, 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856573+0000", 2024-09-18T00:31:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856573+0000", 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856573+0000", 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5200000000000001e-07 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856579+0000", 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856594+0000", 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5007999999999999e-05 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856603+0000", 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9139999999999997e-06 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856653+0000", 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9509999999999999e-05 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.856672+0000", 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9646000000000001e-05 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.857348+0000", 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00067539499999999997 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:47.857393+0000", 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5819999999999998e-05 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:9 3.1a e26/23 3:5cea7035:::rbd_info:head v 26'2, mlcod=0'0)", 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:48.860061+0000", 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.41457488300000001, 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00078326199999999996, 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860061+0000", 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860061+0000", 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860061+0000", 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899999999999998e-07 2024-09-18T00:31:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860068+0000", 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3749999999999999e-06 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860079+0000", 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860090+0000", 2024-09-18T00:31:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0682999999999999e-05 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860146+0000", 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6070999999999999e-05 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860166+0000", 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0162000000000001e-05 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860799+0000", 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00063306699999999996 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.860844+0000", 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5169000000000001e-05 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:12 3.1a e26/23 3:5b2bfc42:::rbd_header.1197a61ea2a8:head v 26'3, mlcod=25'1)", 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:48.868546+0000", 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.406090373, 2024-09-18T00:31:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072441599999999997, 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868546+0000", 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868546+0000", 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868547+0000", 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031e-06 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868560+0000", 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3193999999999999e-05 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868575+0000", 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5684000000000001e-05 2024-09-18T00:31:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868594+0000", 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8224999999999999e-05 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868651+0000", 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621999999999998e-05 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.868677+0000", 2024-09-18T00:31:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330999999999999e-05 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.869235+0000", 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00055849600000000001 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.869270+0000", 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4832999999999997e-05 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:25 3.1a e26/23 3:5b2bfc42:::rbd_header.1197a61ea2a8:head v 26'4, mlcod=26'2)", 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:48.878184+0000", 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.39645208700000001, 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000586934, 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878184+0000", 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878184+0000", 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878185+0000", 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2860000000000001e-06 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878195+0000", 2024-09-18T00:31:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8050000000000001e-06 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878210+0000", 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.554e-05 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878223+0000", 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2092999999999999e-05 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878285+0000", 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2618000000000003e-05 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878304+0000", 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8590999999999999e-05 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878741+0000", 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00043676300000000001 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.878771+0000", 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0238000000000001e-05 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.302 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:49.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:31:49.304 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:49.302+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:49.404 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:49.403+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:49.448 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:49.448 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:49.448 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:49.448 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:49.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:31:49.505 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:49.504+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:49.562 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:49.562 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:49.562 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:49.563 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:49.563 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:49.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:31:49.612 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:49.611+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:49.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:31:49.707 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:49.705+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:49.716 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4281.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.57169375, 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00093050499999999998, 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144154+0000", 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5600000000000005e-07 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144165+0000", 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1593000000000001e-05 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144174+0000", 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5809999999999997e-06 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144183+0000", 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4790000000000002e-06 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144231+0000", 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7809000000000003e-05 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144258+0000", 2024-09-18T00:31:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6301000000000001e-05 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.145041+0000", 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00078354599999999998 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.145084+0000", 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2540000000000003e-05 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:49.722 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:49.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:31:49.810 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:49.809+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:49.826 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:49.845 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:49.858 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T00:31:49.865 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:49.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T00:31:49.878 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:49.879 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:49.887 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:49.887 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:49.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:31:49.905 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:49.909 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:49.907+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:49.922 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:49.952 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:49.971 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:49.971 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:50.010 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:50.008+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:50.014 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.014 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:31:50.111 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:50.109+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:50.170 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.170 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.179 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:31:50.224 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:50.222+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:50.295 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.295 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.304 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:31:50.345 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:50.343+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:50.412 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:50.411+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:50.449 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.449 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:31:50.513 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:50.512+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:50.560 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.560 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:31:50.599 INFO:teuthology.orchestra.run.smithi081.stdout:1 write 0x9106ec6 thru 0x9115dd8 (0xef13 bytes) 2024-09-18T00:31:50.602 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:50.602 INFO:teuthology.orchestra.run.smithi081.stdout:3 write 0x1eb7601 thru 0x1ec3941 (0xc341 bytes) 2024-09-18T00:31:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:4 read 0x492f19 thru 0x494da3 (0x1e8b bytes) 2024-09-18T00:31:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:5 punch from 0x493e55b to 0x49404d9, (0x1f7e bytes) 2024-09-18T00:31:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:8 read 0x4d7d753 thru 0x4d8af0f (0xd7bd bytes) 2024-09-18T00:31:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:9 write 0x419f48d thru 0x41a2a39 (0x35ad bytes) 2024-09-18T00:31:50.611 INFO:teuthology.orchestra.run.smithi081.stdout:10 punch from 0x485797f to 0x4864d67, (0xd3e8 bytes) 2024-09-18T00:31:50.612 INFO:teuthology.orchestra.run.smithi081.stdout:11 write 0x69eba4e thru 0x69f7f8c (0xc53f bytes) 2024-09-18T00:31:50.614 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:50.612+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:50.624 INFO:teuthology.orchestra.run.smithi081.stdout:12 write 0xb8b98e9 thru 0xb8c63d2 (0xcaea bytes) 2024-09-18T00:31:50.628 INFO:teuthology.orchestra.run.smithi081.stdout:15 punch from 0x58c9d64 to 0x58cec7f, (0x4f1b bytes) 2024-09-18T00:31:50.628 INFO:teuthology.orchestra.run.smithi081.stdout:16 punch from 0x27131b2 to 0x2723075, (0xfec3 bytes) 2024-09-18T00:31:50.628 INFO:teuthology.orchestra.run.smithi081.stdout:17 punch from 0xd20932 to 0xd21e01, (0x14cf bytes) 2024-09-18T00:31:50.628 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xbd8578a 2024-09-18T00:31:50.628 INFO:teuthology.orchestra.run.smithi081.stdout:21 trunc from 0xb8c63d3 to 0xbd8578a 2024-09-18T00:31:50.634 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:50.634 INFO:teuthology.orchestra.run.smithi081.stdout:23 write 0x9fca767 thru 0x9fcb447 (0xce1 bytes) 2024-09-18T00:31:50.637 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:50.637 INFO:teuthology.orchestra.run.smithi081.stdout:25 clone 1 order 21 su 1048576 sc 7 2024-09-18T00:31:50.678 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.678 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.686 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:31:50.715 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:50.713+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:50.816 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:50.813+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:50.830 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.830 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:31:50.866 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T00:31:50.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:31:50.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T00:31:50.922 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:50.921+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:50.983 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:50.984 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:50.992 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:31:51.036 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:51.034+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:51.051 INFO:teuthology.orchestra.run.smithi081.stdout:26 write 0x7e9da4e thru 0x7ea7f7d (0xa530 bytes) 2024-09-18T00:31:51.061 INFO:teuthology.orchestra.run.smithi081.stdout:27 writesame 0x3cd23ad thru 0x3ce0c3d data_size 0x1(0xe891 bytes) 2024-09-18T00:31:51.098 INFO:teuthology.orchestra.run.smithi081.stdout:28 punch from 0xa6749a3 to 0xa67736e, (0x29cb bytes) 2024-09-18T00:31:51.098 INFO:teuthology.orchestra.run.smithi081.stdout:31 write 0x8e2e3af thru 0x8e3228d (0x3edf bytes) 2024-09-18T00:31:51.099 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.099 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:33 read 0x1d4fd99 thru 0x1d5dc95 (0xdefd bytes) 2024-09-18T00:31:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:34 writesame 0x7406ea9 thru 0x740ac13 data_size 0x3(0x3d6b bytes) 2024-09-18T00:31:51.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:31:51.111 INFO:teuthology.orchestra.run.smithi081.stdout:37 writesame 0x6358be3 thru 0x6367dc8 data_size 0x3(0xf1e6 bytes) 2024-09-18T00:31:51.119 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:51.117+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:51.124 INFO:teuthology.orchestra.run.smithi081.stdout:38 write 0x8ac8368 thru 0x8ad3e5e (0xbaf7 bytes) 2024-09-18T00:31:51.129 INFO:teuthology.orchestra.run.smithi081.stdout:39 read 0xa1aa52f thru 0xa1b8cbb (0xe78d bytes) 2024-09-18T00:31:51.129 INFO:teuthology.orchestra.run.smithi081.stdout:40 writesame 0x4747c00 thru 0x4756a3c data_size 0x1(0xee3d bytes) 2024-09-18T00:31:51.181 INFO:teuthology.orchestra.run.smithi081.stdout:43 trunc from 0xbd8578a to 0x9f1eac 2024-09-18T00:31:51.209 INFO:teuthology.orchestra.run.smithi081.stdout:44 read 0x987738 thru 0x98e2b8 (0x6b81 bytes) 2024-09-18T00:31:51.209 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.220 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:51.218+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:51.220 INFO:teuthology.orchestra.run.smithi081.stdout:46 trunc from 0x9f1eac to 0x9b343ca 2024-09-18T00:31:51.227 INFO:teuthology.orchestra.run.smithi081.stdout:47 punch from 0x71f9b2a to 0x71fb229, (0x16ff bytes) 2024-09-18T00:31:51.234 INFO:teuthology.orchestra.run.smithi081.stdout:49 write 0xaff70d5 thru 0xb006cb1 (0xfbdd bytes) 2024-09-18T00:31:51.239 INFO:teuthology.orchestra.run.smithi081.stdout:50 writesame 0x4f215bf thru 0x4f2efba data_size 0xe(0xd9fc bytes) 2024-09-18T00:31:51.244 INFO:teuthology.orchestra.run.smithi081.stdout:51 read 0x556afb5 thru 0x5579ac3 (0xeb0f bytes) 2024-09-18T00:31:51.245 INFO:teuthology.orchestra.run.smithi081.stdout:52 punch from 0xa05bf88 to 0xa06baae, (0xfb26 bytes) 2024-09-18T00:31:51.254 INFO:teuthology.orchestra.run.smithi081.stdout:53 write 0xea59250 thru 0xea5e608 (0x53b9 bytes) 2024-09-18T00:31:51.255 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.256 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.256 INFO:teuthology.orchestra.run.smithi081.stdout:54 read 0xd127b9d thru 0xd135fbf (0xe423 bytes) 2024-09-18T00:31:51.256 INFO:teuthology.orchestra.run.smithi081.stdout:55 write 0x6a99712 thru 0x6aa888f (0xf17e bytes) 2024-09-18T00:31:51.260 INFO:teuthology.orchestra.run.smithi081.stdout:56 write 0x6b89019 thru 0x6b95707 (0xc6ef bytes) 2024-09-18T00:31:51.263 INFO:teuthology.orchestra.run.smithi081.stdout:57 read 0x433d04 thru 0x43c2d4 (0x85d1 bytes) 2024-09-18T00:31:51.264 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.264 INFO:teuthology.orchestra.run.smithi081.stdout:62 punch from 0x661d763 to 0x661ecbd, (0x155a bytes) 2024-09-18T00:31:51.264 INFO:teuthology.orchestra.run.smithi081.stdout:65 write 0x5a46eaa thru 0x5a4cc4b (0x5da2 bytes) 2024-09-18T00:31:51.265 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:31:51.268 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.268 INFO:teuthology.orchestra.run.smithi081.stdout:67 write 0x4a00da0 thru 0x4a0501f (0x4280 bytes) 2024-09-18T00:31:51.272 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xd94024c 2024-09-18T00:31:51.273 INFO:teuthology.orchestra.run.smithi081.stdout:68 trunc from 0xea5e609 to 0xd94024c 2024-09-18T00:31:51.282 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.290 INFO:teuthology.orchestra.run.smithi081.stdout:71 trunc from 0xd94024c to 0x6ffa3cf 2024-09-18T00:31:51.301 INFO:teuthology.orchestra.run.smithi081.stdout:73 write 0x15e84d8 thru 0x15f3a97 (0xb5c0 bytes) 2024-09-18T00:31:51.304 INFO:teuthology.orchestra.run.smithi081.stdout:75 trunc from 0x6ffa3cf to 0x6a838c1 2024-09-18T00:31:51.315 INFO:teuthology.orchestra.run.smithi081.stdout:77 trunc from 0x6a838c1 to 0x328b351 2024-09-18T00:31:51.320 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:51.317+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:51.329 INFO:teuthology.orchestra.run.smithi081.stdout:78 read 0x27e9a0a thru 0x27f67a5 (0xcd9c bytes) 2024-09-18T00:31:51.341 INFO:teuthology.orchestra.run.smithi081.stdout:79 writesame 0x90e9e14 thru 0x90ec101 data_size 0x2(0x22ee bytes) 2024-09-18T00:31:51.341 INFO:teuthology.orchestra.run.smithi081.stdout:83 punch from 0x3207a2c to 0x320d754, (0x5d28 bytes) 2024-09-18T00:31:51.342 INFO:teuthology.orchestra.run.smithi081.stdout:84 read 0x3712361 thru 0x371bf01 (0x9ba1 bytes) 2024-09-18T00:31:51.342 INFO:teuthology.orchestra.run.smithi081.stdout:85 read 0x82619a thru 0x82bda2 (0x5c09 bytes) 2024-09-18T00:31:51.342 INFO:teuthology.orchestra.run.smithi081.stdout:86 write 0x5df6ab8 thru 0x5dfc1b1 (0x56fa bytes) 2024-09-18T00:31:51.357 INFO:teuthology.orchestra.run.smithi081.stdout:87 write 0xeb1a5ab thru 0xeb2a409 (0xfe5f bytes) 2024-09-18T00:31:51.360 INFO:teuthology.orchestra.run.smithi081.stdout:89 write 0xaf87cc4 thru 0xaf8e5c7 (0x6904 bytes) 2024-09-18T00:31:51.364 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.364 INFO:teuthology.orchestra.run.smithi081.stdout:95 writesame 0x9ea748a thru 0x9eab5e6 data_size 0x1(0x415d bytes) 2024-09-18T00:31:51.374 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.375 INFO:teuthology.orchestra.run.smithi081.stdout:97 writesame 0xc899204 thru 0xc89f91e data_size 0x1(0x671b bytes) 2024-09-18T00:31:51.377 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.377 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:31:51.388 INFO:teuthology.orchestra.run.smithi081.stdout:98 write 0x8e2db12 thru 0x8e2e17d (0x66c bytes) 2024-09-18T00:31:51.393 INFO:teuthology.orchestra.run.smithi081.stdout:99 punch from 0xe7ccb84 to 0xe7d98b0, (0xcd2c bytes) 2024-09-18T00:31:51.393 INFO:teuthology.orchestra.run.smithi081.stdout:100 read 0x9006a01 thru 0x90073bd (0x9bd bytes) 2024-09-18T00:31:51.393 INFO:teuthology.orchestra.run.smithi081.stdout:102 write 0x8fd443a thru 0x8fd9310 (0x4ed7 bytes) 2024-09-18T00:31:51.396 INFO:teuthology.orchestra.run.smithi081.stdout:103 punch from 0xa71add1 to 0xa72ac24, (0xfe53 bytes) 2024-09-18T00:31:51.408 INFO:teuthology.orchestra.run.smithi081.stdout:104 trunc from 0xeb2a40a to 0x3f82b30 2024-09-18T00:31:51.419 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.419 INFO:teuthology.orchestra.run.smithi081.stdout:109 punch from 0x3eefe3b to 0x3ef816c, (0x8331 bytes) 2024-09-18T00:31:51.420 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:51.419+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:51.426 INFO:teuthology.orchestra.run.smithi081.stdout:110 writesame 0x544f246 thru 0x545b295 data_size 0x88(0xc050 bytes) 2024-09-18T00:31:51.440 INFO:teuthology.orchestra.run.smithi081.stdout:111 write 0xd44053b thru 0xd444711 (0x41d7 bytes) 2024-09-18T00:31:51.443 INFO:teuthology.orchestra.run.smithi081.stdout:113 write 0x5600bd6 thru 0x5607edb (0x7306 bytes) 2024-09-18T00:31:51.446 INFO:teuthology.orchestra.run.smithi081.stdout:115 read 0xb91354d thru 0xb9188da (0x538e bytes) 2024-09-18T00:31:51.446 INFO:teuthology.orchestra.run.smithi081.stdout:116 read 0xb0371b1 thru 0xb0426d7 (0xb527 bytes) 2024-09-18T00:31:51.453 INFO:teuthology.orchestra.run.smithi081.stdout:117 write 0xec4739d thru 0xec520ff (0xad63 bytes) 2024-09-18T00:31:51.456 INFO:teuthology.orchestra.run.smithi081.stdout:118 punch from 0x8569835 to 0x8572eba, (0x9685 bytes) 2024-09-18T00:31:51.466 INFO:teuthology.orchestra.run.smithi081.stdout:119 trunc from 0xec52100 to 0x6792b20 2024-09-18T00:31:51.475 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.475 INFO:teuthology.orchestra.run.smithi081.stdout:121 punch from 0x5f67c9e to 0x5f6f85d, (0x7bbf bytes) 2024-09-18T00:31:51.475 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.476 INFO:teuthology.orchestra.run.smithi081.stdout:123 trunc from 0x6792b20 to 0x7968a89 2024-09-18T00:31:51.482 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.482 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.483 INFO:teuthology.orchestra.run.smithi081.stdout:126 punch from 0x2dd33ba to 0x2ddf482, (0xc0c8 bytes) 2024-09-18T00:31:51.483 INFO:teuthology.orchestra.run.smithi081.stdout:128 read 0x20b6d61 thru 0x20be417 (0x76b7 bytes) 2024-09-18T00:31:51.483 INFO:teuthology.orchestra.run.smithi081.stdout:129 read 0x6ccbe5 thru 0x6d614f (0x956b bytes) 2024-09-18T00:31:51.483 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.486 INFO:teuthology.orchestra.run.smithi081.stdout:131 trunc from 0x7968a89 to 0x4fe9388 2024-09-18T00:31:51.506 INFO:teuthology.orchestra.run.smithi081.stdout:132 writesame 0x87c10f1 thru 0x87c93cb data_size 0x1(0x82db bytes) 2024-09-18T00:31:51.506 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.506 INFO:teuthology.orchestra.run.smithi081.stdout:136 punch from 0x4469642 to 0x4472103, (0x8ac1 bytes) 2024-09-18T00:31:51.506 INFO:teuthology.orchestra.run.smithi081.stdout:137 write 0x291e827 thru 0x292931d (0xaaf7 bytes) 2024-09-18T00:31:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:139 write 0x1d15cea thru 0x1d1f40b (0x9722 bytes) 2024-09-18T00:31:51.513 INFO:teuthology.orchestra.run.smithi081.stdout:140 punch from 0x3f91208 to 0x3f98d33, (0x7b2b bytes) 2024-09-18T00:31:51.513 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.513 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.514 INFO:teuthology.orchestra.run.smithi081.stdout:144 trunc from 0x87c93cc to 0x99d42fd 2024-09-18T00:31:51.519 INFO:teuthology.orchestra.run.smithi081.stdout:145 writesame 0x22101d3 thru 0x2216ced data_size 0x1(0x6b1b bytes) 2024-09-18T00:31:51.521 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:51.519+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:51.534 INFO:teuthology.orchestra.run.smithi081.stdout:146 read 0x1cc6d8d thru 0x1ccd3e5 (0x6659 bytes) 2024-09-18T00:31:51.534 INFO:teuthology.orchestra.run.smithi081.stdout:147 read 0x29b8dda thru 0x29c114b (0x8372 bytes) 2024-09-18T00:31:51.534 INFO:teuthology.orchestra.run.smithi081.stdout:148 read 0x704f2ec thru 0x704fc39 (0x94e bytes) 2024-09-18T00:31:51.535 INFO:teuthology.orchestra.run.smithi081.stdout:149 write 0x5a78d75 thru 0x5a8333e (0xa5ca bytes) 2024-09-18T00:31:51.537 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.537 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.546 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:31:51.547 INFO:teuthology.orchestra.run.smithi081.stdout:150 write 0xbad2417 thru 0xbade3a4 (0xbf8e bytes) 2024-09-18T00:31:51.550 INFO:teuthology.orchestra.run.smithi081.stdout:151 read 0x9cf6784 thru 0x9d0369d (0xcf1a bytes) 2024-09-18T00:31:51.550 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.550 INFO:teuthology.orchestra.run.smithi081.stdout:153 read 0x1fc85f5 thru 0x1fd7d0c (0xf718 bytes) 2024-09-18T00:31:51.550 INFO:teuthology.orchestra.run.smithi081.stdout:154 punch from 0xa36012e to 0xa36de12, (0xdce4 bytes) 2024-09-18T00:31:51.550 INFO:teuthology.orchestra.run.smithi081.stdout:155 write 0x69dafd3 thru 0x69e6354 (0xb382 bytes) 2024-09-18T00:31:51.553 INFO:teuthology.orchestra.run.smithi081.stdout:156 read 0x1efabda thru 0x1f0989d (0xecc4 bytes) 2024-09-18T00:31:51.553 INFO:teuthology.orchestra.run.smithi081.stdout:157 read 0x1eb70b4 thru 0x1ec2915 (0xb862 bytes) 2024-09-18T00:31:51.554 INFO:teuthology.orchestra.run.smithi081.stdout:158 read 0x459d47a thru 0x45a8d16 (0xb89d bytes) 2024-09-18T00:31:51.554 INFO:teuthology.orchestra.run.smithi081.stdout:160 read 0x8a87b81 thru 0x8a8bd30 (0x41b0 bytes) 2024-09-18T00:31:51.554 INFO:teuthology.orchestra.run.smithi081.stdout:161 write 0x724a922 thru 0x7256ce8 (0xc3c7 bytes) 2024-09-18T00:31:51.556 INFO:teuthology.orchestra.run.smithi081.stdout:162 read 0x5d82b10 thru 0x5d91724 (0xec15 bytes) 2024-09-18T00:31:51.560 INFO:teuthology.orchestra.run.smithi081.stdout:163 trunc from 0xbade3a5 to 0x85e4251 2024-09-18T00:31:51.576 INFO:teuthology.orchestra.run.smithi081.stdout:167 writesame 0x6c20422 thru 0x6c25a77 data_size 0x2b(0x5656 bytes) 2024-09-18T00:31:51.585 INFO:teuthology.orchestra.run.smithi081.stdout:168 trunc from 0x85e4251 to 0x304e35a 2024-09-18T00:31:51.595 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.595 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.595 INFO:teuthology.orchestra.run.smithi081.stdout:173 read 0x2754ce5 thru 0x275bae6 (0x6e02 bytes) 2024-09-18T00:31:51.614 INFO:teuthology.orchestra.run.smithi081.stdout:174 writesame 0xe069be0 thru 0xe069dda data_size 0x3(0x1fb bytes) 2024-09-18T00:31:51.614 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.614 INFO:teuthology.orchestra.run.smithi081.stdout:177 read 0xf7cc68 thru 0xf871e8 (0xa581 bytes) 2024-09-18T00:31:51.614 INFO:teuthology.orchestra.run.smithi081.stdout:178 read 0x71ebac thru 0x7240ad (0x5502 bytes) 2024-09-18T00:31:51.615 INFO:teuthology.orchestra.run.smithi081.stdout:180 read 0x613f5af thru 0x6141963 (0x23b5 bytes) 2024-09-18T00:31:51.615 INFO:teuthology.orchestra.run.smithi081.stdout:181 write 0x80a8578 thru 0x80ab9c5 (0x344e bytes) 2024-09-18T00:31:51.617 INFO:teuthology.orchestra.run.smithi081.stdout:184 writesame 0x6cf163d thru 0x6cfc7b1 data_size 0x13(0xb175 bytes) 2024-09-18T00:31:51.621 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.621 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.621 INFO:teuthology.orchestra.run.smithi081.stdout:188 punch from 0x5a84943 to 0x5a8998f, (0x504c bytes) 2024-09-18T00:31:51.622 INFO:teuthology.orchestra.run.smithi081.stdout:190 read 0xb71b066 thru 0xb72674f (0xb6ea bytes) 2024-09-18T00:31:51.622 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:51.620+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:51.625 INFO:teuthology.orchestra.run.smithi081.stdout:192 trunc from 0xe069ddb to 0xb15d521 2024-09-18T00:31:51.630 INFO:teuthology.orchestra.run.smithi081.stdout:193 write 0x28a41d6 thru 0x28b175d (0xd588 bytes) 2024-09-18T00:31:51.634 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.634 INFO:teuthology.orchestra.run.smithi081.stdout:196 punch from 0x9e14bdf to 0x9e18250, (0x3671 bytes) 2024-09-18T00:31:51.634 INFO:teuthology.orchestra.run.smithi081.stdout:198 writesame 0x6d53394 thru 0x6d560aa data_size 0x11(0x2d17 bytes) 2024-09-18T00:31:51.637 INFO:teuthology.orchestra.run.smithi081.stdout:199 write 0x4354eb5 thru 0x43593cb (0x4517 bytes) 2024-09-18T00:31:51.640 INFO:teuthology.orchestra.run.smithi081.stdout:200 punch from 0x74a2ff to 0x75161b, (0x731c bytes) 2024-09-18T00:31:51.640 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.640 INFO:teuthology.orchestra.run.smithi081.stdout:202 write 0x76ee2b1 thru 0x76ee9e7 (0x737 bytes) 2024-09-18T00:31:51.643 INFO:teuthology.orchestra.run.smithi081.stdout:203 write 0x7409c4f thru 0x740ca65 (0x2e17 bytes) 2024-09-18T00:31:51.645 INFO:teuthology.orchestra.run.smithi081.stdout:206 read 0x6d326d6 thru 0x6d39061 (0x698c bytes) 2024-09-18T00:31:51.646 INFO:teuthology.orchestra.run.smithi081.stdout:210 trunc from 0xb15d521 to 0xb564d2f 2024-09-18T00:31:51.651 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.651 INFO:teuthology.orchestra.run.smithi081.stdout:214 write 0x5610101 thru 0x56103a5 (0x2a5 bytes) 2024-09-18T00:31:51.654 INFO:teuthology.orchestra.run.smithi081.stdout:215 read 0x73f2cfa thru 0x7402320 (0xf627 bytes) 2024-09-18T00:31:51.654 INFO:teuthology.orchestra.run.smithi081.stdout:216 read 0x219fd5a thru 0x21a1758 (0x19ff bytes) 2024-09-18T00:31:51.661 INFO:teuthology.orchestra.run.smithi081.stdout:217 write 0xb93d893 thru 0xb949981 (0xc0ef bytes) 2024-09-18T00:31:51.671 INFO:teuthology.orchestra.run.smithi081.stdout:218 write 0xceb89d0 thru 0xcec749d (0xeace bytes) 2024-09-18T00:31:51.675 INFO:teuthology.orchestra.run.smithi081.stdout:219 write 0x2797e3 thru 0x27a523 (0xd41 bytes) 2024-09-18T00:31:51.676 INFO:teuthology.orchestra.run.smithi081.stdout:220 writesame 0x10dc5e4 thru 0x10e3a73 data_size 0x28(0x7490 bytes) 2024-09-18T00:31:51.680 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.680 INFO:teuthology.orchestra.run.smithi081.stdout:222 read 0xb3be453 thru 0xb3c5047 (0x6bf5 bytes) 2024-09-18T00:31:51.680 INFO:teuthology.orchestra.run.smithi081.stdout:223 writesame 0xaa2c755 thru 0xaa391ff data_size 0xd(0xcaab bytes) 2024-09-18T00:31:51.685 INFO:teuthology.orchestra.run.smithi081.stdout:224 read 0x6368689 thru 0x637613a (0xdab2 bytes) 2024-09-18T00:31:51.685 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.685 INFO:teuthology.orchestra.run.smithi081.stdout:226 write 0x2f05eb1 thru 0x2f0b316 (0x5466 bytes) 2024-09-18T00:31:51.688 INFO:teuthology.orchestra.run.smithi081.stdout:228 writesame 0xbc68fb9 thru 0xbc696de data_size 0xf(0x726 bytes) 2024-09-18T00:31:51.691 INFO:teuthology.orchestra.run.smithi081.stdout:229 write 0x954ecff thru 0x9555fa8 (0x72aa bytes) 2024-09-18T00:31:51.693 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.693 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.698 INFO:teuthology.orchestra.run.smithi081.stdout:230 write 0x584c0d2 thru 0x5851e67 (0x5d96 bytes) 2024-09-18T00:31:51.702 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.702 INFO:teuthology.orchestra.run.smithi081.stdout:233 punch from 0x9ed1d4b to 0x9edd31f, (0xb5d4 bytes) 2024-09-18T00:31:51.702 INFO:teuthology.orchestra.run.smithi081.stdout:234 read 0x28d5452 thru 0x28e038c (0xaf3b bytes) 2024-09-18T00:31:51.702 INFO:teuthology.orchestra.run.smithi081.stdout:236 read 0x68f8db3 thru 0x68fe315 (0x5563 bytes) 2024-09-18T00:31:51.702 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.702 INFO:teuthology.orchestra.run.smithi081.stdout:239 punch from 0xcaa8c11 to 0xcab7925, (0xed14 bytes) 2024-09-18T00:31:51.703 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:31:51.712 INFO:teuthology.orchestra.run.smithi081.stdout:240 trunc from 0xcec749e to 0x45e2b06 2024-09-18T00:31:51.741 INFO:teuthology.orchestra.run.smithi081.stdout:241 write 0xb74959f thru 0xb7499dd (0x43f bytes) 2024-09-18T00:31:51.744 INFO:teuthology.orchestra.run.smithi081.stdout:242 writesame 0x2c16d0 thru 0x2c7bad data_size 0x1(0x64de bytes) 2024-09-18T00:31:51.747 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:51.745+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:51.760 INFO:teuthology.orchestra.run.smithi081.stdout:243 write 0x934d020 thru 0x935162e (0x460f bytes) 2024-09-18T00:31:51.771 INFO:teuthology.orchestra.run.smithi081.stdout:244 writesame 0xd4a663d thru 0xd4aa5f0 data_size 0x36(0x3fb4 bytes) 2024-09-18T00:31:51.786 INFO:teuthology.orchestra.run.smithi081.stdout:245 trunc from 0xd4aa5f1 to 0x153c876 2024-09-18T00:31:51.803 INFO:teuthology.orchestra.run.smithi081.stdout:246 trunc from 0x153c876 to 0x4f6e01f 2024-09-18T00:31:51.808 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:51.813 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.813 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.823 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:51.820+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:51.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:31:51.825 INFO:teuthology.orchestra.run.smithi081.stdout:248 write 0xd14aa5e thru 0xd15063f (0x5be2 bytes) 2024-09-18T00:31:51.827 INFO:teuthology.orchestra.run.smithi081.stdout:249 read 0xa61f00d thru 0xa62b24e (0xc242 bytes) 2024-09-18T00:31:51.827 INFO:teuthology.orchestra.run.smithi081.stdout:250 read 0x54adfad thru 0x54b167e (0x36d2 bytes) 2024-09-18T00:31:51.827 INFO:teuthology.orchestra.run.smithi081.stdout:251 clone 2 order 18 su 2048 sc 14 2024-09-18T00:31:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:31:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T00:31:51.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T00:31:51.923 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:51.921+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:51.936 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:51.936 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:51.937 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone1 from 0xd150640 (overlap 0x9f1eac) to 0x0 2024-09-18T00:31:51.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:31:51.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:31:51.993 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-18T00:31:52.036 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:52.034+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:52.086 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:52.086 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:52.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:31:52.126 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:52.124+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:52.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:52.136 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:52.165 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:52.192 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:52.210 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:52.227 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:52.224+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:52.228 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:52.228 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:52.246 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:52.246 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:52.247 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:52.247 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:52.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:52.247 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:52.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.247 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.116485+0000", 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.127909208999998, 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037829389999999999, 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116485+0000", 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116485+0000", 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116486+0000", 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5499999999999998e-07 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116565+0000", 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9426999999999997e-05 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116573+0000", 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6340000000000001e-06 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116577+0000", 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.301e-06 2024-09-18T00:31:52.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116617+0000", 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9567999999999998e-05 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116631+0000", 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4056999999999999e-05 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120226+0000", 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035950079999999998 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120268+0000", 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2388999999999997e-05 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:22 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'12, mlcod=16'8)", 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:52.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.127444716999999, 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003338789, 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116950+0000", 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3000000000000001e-07 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116955+0000", 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116961+0000", 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.652e-06 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116965+0000", 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5279999999999999e-06 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.116999+0000", 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4504e-05 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.117014+0000", 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4533e-05 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120271+0000", 2024-09-18T00:31:52.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032572579999999999 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.120288+0000", 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7028999999999999e-05 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.136279+0000", 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.108114930999999, 2024-09-18T00:31:52.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050306079999999998, 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136279+0000", 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136279+0000", 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136280+0000", 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136285+0000", 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8509999999999998e-06 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136291+0000", 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136295+0000", 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4539999999999999e-06 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136328+0000", 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3510000000000003e-05 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.136341+0000", 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2254e-05 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141265+0000", 2024-09-18T00:31:52.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049247839999999998 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141310+0000", 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4520000000000001e-05 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'16)", 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.107336631999999, 2024-09-18T00:31:52.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042719469999999999, 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137058+0000", 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1999999999999999e-07 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137063+0000", 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.147e-06 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137075+0000", 2024-09-18T00:31:52.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.165e-05 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137080+0000", 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137124+0000", 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4038000000000001e-05 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137136+0000", 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2359e-05 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141313+0000", 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041762709999999996 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141330+0000", 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6799e-05 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'16)", 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.106838561, 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037897730000000002, 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137556+0000", 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2300000000000002e-07 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137628+0000", 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2243999999999995e-05 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137636+0000", 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4039999999999998e-06 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137640+0000", 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3869999999999997e-06 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137683+0000", 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2759000000000002e-05 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.137697+0000", 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4415e-05 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141330+0000", 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036330440000000002 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.141345+0000", 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5097e-05 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:37 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'23, mlcod=16'16)", 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.105763402000001, 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054426049999999997, 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138631+0000", 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6000000000000004e-07 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138637+0000", 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4360000000000001e-06 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138648+0000", 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.155e-05 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138654+0000", 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2560000000000002e-06 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138688+0000", 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3890000000000002e-05 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.138699+0000", 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1413000000000001e-05 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.143993+0000", 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005294104 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.144073+0000", 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0395999999999994e-05 2024-09-18T00:31:52.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.064639410000002, 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034774379999999998, 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179755+0000", 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0299999999999999e-07 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179811+0000", 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5195999999999998e-05 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179818+0000", 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8599999999999993e-06 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179824+0000", 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-18T00:31:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179856+0000", 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2051999999999997e-05 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.179869+0000", 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2948e-05 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.183201+0000", 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003331643 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.183232+0000", 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1596e-05 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.328262+0000", 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.916131904, 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057528869999999999, 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328262+0000", 2024-09-18T00:31:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328262+0000", 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328263+0000", 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328329+0000", 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6519999999999993e-05 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328337+0000", 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5039999999999996e-06 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328341+0000", 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8750000000000002e-06 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328376+0000", 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5318000000000003e-05 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328389+0000", 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.275e-05 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333990+0000", 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056012739999999998 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334015+0000", 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5236999999999999e-05 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.915493321, 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051417349999999997, 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328901+0000", 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328911+0000", 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9189999999999994e-06 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328917+0000", 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7400000000000001e-06 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328920+0000", 2024-09-18T00:31:52.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1990000000000002e-06 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328951+0000", 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0732000000000003e-05 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.328962+0000", 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1362000000000001e-05 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334017+0000", 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050542429999999999 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334043+0000", 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6125000000000001e-05 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'65)", 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.329504+0000", 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.914889883000001, 2024-09-18T00:31:52.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00456085, 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329504+0000", 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329504+0000", 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329505+0000", 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7700000000000005e-07 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329510+0000", 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2789999999999998e-06 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329517+0000", 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6919999999999996e-06 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329521+0000", 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329553+0000", 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2410000000000003e-05 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329565+0000", 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2328e-05 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334044+0000", 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044781919999999998 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334065+0000", 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1562000000000001e-05 2024-09-18T00:31:52.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'65)", 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.914427701000001, 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041219459999999996, 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.329967+0000", 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:31:52.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330034+0000", 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6576999999999996e-05 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330040+0000", 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3609999999999997e-06 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330043+0000", 2024-09-18T00:31:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1489999999999998e-06 2024-09-18T00:31:52.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330075+0000", 2024-09-18T00:31:52.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2128999999999997e-05 2024-09-18T00:31:52.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.330086+0000", 2024-09-18T00:31:52.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.115e-05 2024-09-18T00:31:52.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334068+0000", 2024-09-18T00:31:52.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039811810000000003 2024-09-18T00:31:52.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.334088+0000", 2024-09-18T00:31:52.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0981000000000001e-05 2024-09-18T00:31:52.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'65)", 2024-09-18T00:31:52.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.332141+0000", 2024-09-18T00:31:52.303 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.912253188000001, 2024-09-18T00:31:52.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045817569999999997, 2024-09-18T00:31:52.304 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332141+0000", 2024-09-18T00:31:52.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332141+0000", 2024-09-18T00:31:52.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332142+0000", 2024-09-18T00:31:52.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.13e-06 2024-09-18T00:31:52.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332150+0000", 2024-09-18T00:31:52.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1340000000000004e-06 2024-09-18T00:31:52.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332169+0000", 2024-09-18T00:31:52.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8938999999999999e-05 2024-09-18T00:31:52.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332180+0000", 2024-09-18T00:31:52.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.048e-05 2024-09-18T00:31:52.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332282+0000", 2024-09-18T00:31:52.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010231800000000001 2024-09-18T00:31:52.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332315+0000", 2024-09-18T00:31:52.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2539999999999997e-05 2024-09-18T00:31:52.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336697+0000", 2024-09-18T00:31:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043823730000000002 2024-09-18T00:31:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336723+0000", 2024-09-18T00:31:52.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5843e-05 2024-09-18T00:31:52.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'66)", 2024-09-18T00:31:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.332624+0000", 2024-09-18T00:31:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.911770180000001, 2024-09-18T00:31:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041224620000000003, 2024-09-18T00:31:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332624+0000", 2024-09-18T00:31:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332624+0000", 2024-09-18T00:31:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332625+0000", 2024-09-18T00:31:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:31:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332630+0000", 2024-09-18T00:31:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4399999999999996e-06 2024-09-18T00:31:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332637+0000", 2024-09-18T00:31:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0589999999999997e-06 2024-09-18T00:31:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332641+0000", 2024-09-18T00:31:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7390000000000001e-06 2024-09-18T00:31:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332677+0000", 2024-09-18T00:31:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5855999999999997e-05 2024-09-18T00:31:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.332690+0000", 2024-09-18T00:31:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3008e-05 2024-09-18T00:31:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336725+0000", 2024-09-18T00:31:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004035014 2024-09-18T00:31:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336747+0000", 2024-09-18T00:31:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1866999999999999e-05 2024-09-18T00:31:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'66)", 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.333103+0000", 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.911290758, 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036652360000000001, 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333103+0000", 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333103+0000", 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333104+0000", 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.37e-07 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333201+0000", 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6475e-05 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333217+0000", 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6439e-05 2024-09-18T00:31:52.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333228+0000", 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0706999999999999e-05 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333308+0000", 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.333340+0000", 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1949000000000002e-05 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336748+0000", 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00340735 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.336769+0000", 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1209999999999999e-05 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:146 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'104, mlcod=16'102)", 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.574052389999999, 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049876579999999998, 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670342+0000", 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000005e-07 2024-09-18T00:31:52.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670349+0000", 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2009999999999996e-06 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670358+0000", 2024-09-18T00:31:52.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7899999999999994e-06 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670363+0000", 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4410000000000003e-06 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670446+0000", 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2968999999999998e-05 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.670458+0000", 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2388000000000001e-05 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.675252+0000", 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047935549999999997 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:30.675330+0000", 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7688999999999994e-05 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:154 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'108, mlcod=16'105)", 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.12317453, 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037158859999999998, 2024-09-18T00:31:52.336 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121220+0000", 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121229+0000", 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5690000000000005e-06 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121235+0000", 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2809999999999997e-06 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121238+0000", 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2789999999999999e-06 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121275+0000", 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6644999999999999e-05 2024-09-18T00:31:52.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121286+0000", 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0750999999999999e-05 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124908+0000", 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036223549999999998 2024-09-18T00:31:52.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124936+0000", 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7585000000000001e-05 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:155 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'109, mlcod=16'105)", 2024-09-18T00:31:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:52.342 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.122811417000001, 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035924899999999998, 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:52.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121583+0000", 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121690+0000", 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106612 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121697+0000", 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9469999999999997e-06 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121700+0000", 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3100000000000001e-06 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121732+0000", 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2051999999999997e-05 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.121743+0000", 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0613e-05 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125152+0000", 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034096109999999999 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125175+0000", 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2926e-05 2024-09-18T00:31:52.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:156 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'110, mlcod=16'105)", 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.122348507000002, 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033846810000000001, 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122046+0000", 2024-09-18T00:31:52.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2899999999999999e-07 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122052+0000", 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8830000000000003e-06 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122058+0000", 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.728e-06 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.122061+0000", 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1190000000000001e-06 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124221+0000", 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021602040000000002 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.124234+0000", 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3151e-05 2024-09-18T00:31:52.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125408+0000", 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011735059999999999 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.125430+0000", 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2660999999999999e-05 2024-09-18T00:31:52.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4172.0:161 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'115, mlcod=16'112)", 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.116529675999999, 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003404453, 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127865+0000", 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127936+0000", 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1049000000000004e-05 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127942+0000", 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127951+0000", 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2630000000000003e-06 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127985+0000", 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4872000000000001e-05 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.127998+0000", 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2646000000000001e-05 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.131238+0000", 2024-09-18T00:31:52.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032397839999999999 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:31.131269+0000", 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1194e-05 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:48.864091+0000", 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.380302983, 2024-09-18T00:31:52.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003837441, 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864091+0000", 2024-09-18T00:31:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864091+0000", 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864093+0000", 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864107+0000", 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3275000000000001e-05 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864126+0000", 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9660000000000002e-05 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864136+0000", 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5859999999999994e-06 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864206+0000", 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9839000000000007e-05 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.864214+0000", 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.678e-06 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.866169+0000", 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019554189999999999 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.866306+0000", 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013736900000000001 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.866535+0000", 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022862199999999999 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.867481+0000", 2024-09-18T00:31:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00094652699999999996 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.867822+0000", 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034068999999999999 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.867883+0000", 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0640999999999998e-05 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:48.867929+0000", 2024-09-18T00:31:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5902000000000002e-05 2024-09-18T00:31:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.363 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:52.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:31:52.365 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:52.365 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:52.366 INFO:teuthology.orchestra.run.smithi081.stdout:252 write 0x9f84433 thru 0x9f8dbfc (0x97ca bytes) 2024-09-18T00:31:52.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:52.367 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:52.367 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:52.367 INFO:teuthology.orchestra.run.smithi081.stdout:254 writesame 0x5d3ea10 thru 0x5d4126c data_size 0x1(0x285d bytes) 2024-09-18T00:31:52.367 INFO:teuthology.orchestra.run.smithi081.stdout:256 trunc from 0xd150640 to 0x8e68397 2024-09-18T00:31:52.368 INFO:teuthology.orchestra.run.smithi081.stdout:257 writesame 0x107538b thru 0x107ed77 data_size 0x47(0x99ed bytes) 2024-09-18T00:31:52.368 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:52.361+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:52.438 INFO:teuthology.orchestra.run.smithi081.stdout:258 write 0x8615d8e thru 0x8619413 (0x3686 bytes) 2024-09-18T00:31:52.452 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xe7244d3 2024-09-18T00:31:52.459 INFO:teuthology.orchestra.run.smithi081.stdout:260 trunc from 0x8e68397 to 0xe7244d3 2024-09-18T00:31:52.463 INFO:teuthology.orchestra.run.smithi081.stdout:261 writesame 0x1b855ae thru 0x1b89cab data_size 0x1(0x46fe bytes) 2024-09-18T00:31:52.464 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:52.462+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:52.482 INFO:teuthology.orchestra.run.smithi081.stdout:263 read 0x1a96478 thru 0x1aa000a (0x9b93 bytes) 2024-09-18T00:31:52.483 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:52.483 INFO:teuthology.orchestra.run.smithi081.stdout:265 read 0x2bf06e0 thru 0x2bf10d2 (0x9f3 bytes) 2024-09-18T00:31:52.489 INFO:teuthology.orchestra.run.smithi081.stdout:266 trunc from 0xe7244d3 to 0x98fcd0e 2024-09-18T00:31:52.495 INFO:teuthology.orchestra.run.smithi081.stdout:269 write 0x68ac77a thru 0x68b52d7 (0x8b5e bytes) 2024-09-18T00:31:52.523 INFO:teuthology.orchestra.run.smithi081.stdout:270 writesame 0xd9c3ab0 thru 0xd9c4c28 data_size 0x1(0x1179 bytes) 2024-09-18T00:31:52.523 INFO:teuthology.orchestra.run.smithi081.stdout:271 write 0x1f45695 thru 0x1f4be31 (0x679d bytes) 2024-09-18T00:31:52.527 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:52.527 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:52.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:31:52.543 INFO:teuthology.orchestra.run.smithi081.stdout:272 read 0x9714872 thru 0x9720e2d (0xc5bc bytes) 2024-09-18T00:31:52.544 INFO:teuthology.orchestra.run.smithi081.stdout:273 read 0x386b304 thru 0x3876a2c (0xb729 bytes) 2024-09-18T00:31:52.544 INFO:teuthology.orchestra.run.smithi081.stdout:274 read 0x46461bb thru 0x4646666 (0x4ac bytes) 2024-09-18T00:31:52.544 INFO:teuthology.orchestra.run.smithi081.stdout:276 read 0xb27de7d thru 0xb283563 (0x56e7 bytes) 2024-09-18T00:31:52.544 INFO:teuthology.orchestra.run.smithi081.stdout:277 read 0x840c87b thru 0x840f479 (0x2bff bytes) 2024-09-18T00:31:52.544 INFO:teuthology.orchestra.run.smithi081.stdout:279 punch from 0xb474d97 to 0xb47f364, (0xa5cd bytes) 2024-09-18T00:31:52.545 INFO:teuthology.orchestra.run.smithi081.stdout:280 write 0x26facf0 thru 0x270a6ca (0xf9db bytes) 2024-09-18T00:31:52.560 INFO:teuthology.orchestra.run.smithi081.stdout:282 punch from 0x689146e to 0x68a0201, (0xed93 bytes) 2024-09-18T00:31:52.560 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:52.560 INFO:teuthology.orchestra.run.smithi081.stdout:284 writesame 0x911737e thru 0x91248ef data_size 0x15(0xd572 bytes) 2024-09-18T00:31:52.565 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:52.563+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:52.578 INFO:teuthology.orchestra.run.smithi081.stdout:286 write 0xcd7ae9f thru 0xcd875d5 (0xc737 bytes) 2024-09-18T00:31:52.596 INFO:teuthology.orchestra.run.smithi081.stdout:287 writesame 0x5707c44 thru 0x570fb61 data_size 0x35(0x7f1e bytes) 2024-09-18T00:31:52.616 INFO:teuthology.orchestra.run.smithi081.stdout:288 punch from 0x5f6203d to 0x5f6614f, (0x4112 bytes) 2024-09-18T00:31:52.616 INFO:teuthology.orchestra.run.smithi081.stdout:290 read 0x5684881 thru 0x5690027 (0xb7a7 bytes) 2024-09-18T00:31:52.617 INFO:teuthology.orchestra.run.smithi081.stdout:292 write 0xb730c9f thru 0xb73e583 (0xd8e5 bytes) 2024-09-18T00:31:52.632 INFO:teuthology.orchestra.run.smithi081.stdout:296 read 0x263c8be thru 0x26496fd (0xce40 bytes) 2024-09-18T00:31:52.632 INFO:teuthology.orchestra.run.smithi081.stdout:297 write 0x607bfb8 thru 0x607cb21 (0xb6a bytes) 2024-09-18T00:31:52.641 INFO:teuthology.orchestra.run.smithi081.stdout:299 punch from 0xa0692f9 to 0xa077ea4, (0xebab bytes) 2024-09-18T00:31:52.641 INFO:teuthology.orchestra.run.smithi081.stdout:300 read 0x8fc9e21 thru 0x8fd0aa8 (0x6c88 bytes) 2024-09-18T00:31:52.642 INFO:teuthology.orchestra.run.smithi081.stdout:301 write 0x6fb0b87 thru 0x6fbec61 (0xe0db bytes) 2024-09-18T00:31:52.666 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:52.664+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:52.668 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:52.668 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:52.668 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:52.669 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:52.669 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:52.674 INFO:teuthology.orchestra.run.smithi081.stdout:302 trunc from 0xd9c4c29 to 0x1e6d17c 2024-09-18T00:31:52.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:31:52.745 INFO:teuthology.orchestra.run.smithi081.stdout:303 trunc from 0x1e6d17c to 0x4c0acc 2024-09-18T00:31:52.767 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:52.765+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:1001 3.19 3:9e557e3e:::rbd_data.1197f1330e07.0000000000000236:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,truncate 180224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.325839+0000", 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.52044122100000001, 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041130689999999996, 2024-09-18T00:31:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 1001 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325839+0000", 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325839+0000", 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325840+0000", 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325845+0000", 2024-09-18T00:31:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4170000000000002e-06 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325855+0000", 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0219e-05 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325860+0000", 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0030000000000002e-06 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325908+0000", 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8486000000000003e-05 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.325993+0000", 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4573000000000005e-05 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.326116+0000", 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000122889 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329662+0000", 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035457750000000001 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329853+0000", 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019106400000000001 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329906+0000", 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2902000000000003e-05 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329952+0000", 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6474000000000003e-05 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:1002 3.0 3:049b8f32:::rbd_data.1197f1330e07.0000000000000237:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,truncate 180224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.327023+0000", 2024-09-18T00:31:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.51925680600000002, 2024-09-18T00:31:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057637799999999996, 2024-09-18T00:31:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 1002 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327023+0000", 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327023+0000", 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327024+0000", 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7400000000000002e-07 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327030+0000", 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:31:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327041+0000", 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0638999999999999e-05 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327046+0000", 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327097+0000", 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1295000000000003e-05 2024-09-18T00:31:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327210+0000", 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112791 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327349+0000", 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013878299999999999 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329825+0000", 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024767069999999999 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.332731+0000", 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029053939999999999 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.332763+0000", 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2527000000000002e-05 2024-09-18T00:31:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.332787+0000", 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3819999999999999e-05 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:1007 3.8 e29/23 3:15b0a540:::rbd_data.1197f1330e07.000000000000023c:head v 29'9, mlcod=29'7)", 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.330351+0000", 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.51592940300000001, 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052776359999999996, 2024-09-18T00:31:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330351+0000", 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330351+0000", 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330352+0000", 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.99e-07 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330357+0000", 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4079999999999997e-06 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330368+0000", 2024-09-18T00:31:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1379999999999999e-05 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330375+0000", 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6209999999999998e-06 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330429+0000", 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.384e-05 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.330449+0000", 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0333999999999999e-05 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.335566+0000", 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005116804 2024-09-18T00:31:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.335628+0000", 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2550000000000003e-05 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2079 3.19 3:9a43b6ca:::rbd_data.1197f1330e07.0000000000000215:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 81920~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.443576+0000", 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.402704118, 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00529344, 2024-09-18T00:31:52.867 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2079 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443576+0000", 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443576+0000", 2024-09-18T00:31:52.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443578+0000", 2024-09-18T00:31:52.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.035e-06 2024-09-18T00:31:52.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443588+0000", 2024-09-18T00:31:52.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7699999999999996e-06 2024-09-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443603+0000", 2024-09-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4956999999999999e-05 2024-09-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443612+0000", 2024-09-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.132e-06 2024-09-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443666+0000", 2024-09-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4148999999999999e-05 2024-09-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443779+0000", 2024-09-18T00:31:52.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113319 2024-09-18T00:31:52.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.443986+0000", 2024-09-18T00:31:52.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000206498 2024-09-18T00:31:52.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.445711+0000", 2024-09-18T00:31:52.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017247759999999999 2024-09-18T00:31:52.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.448765+0000", 2024-09-18T00:31:52.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003054359 2024-09-18T00:31:52.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.448823+0000", 2024-09-18T00:31:52.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7728e-05 2024-09-18T00:31:52.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.448870+0000", 2024-09-18T00:31:52.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6717e-05 2024-09-18T00:31:52.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2081 3.19 3:99c3af6a:::rbd_data.1197f1330e07.000000000000021d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 81294~626] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.446696+0000", 2024-09-18T00:31:52.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.39958466399999998, 2024-09-18T00:31:52.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049949570000000004, 2024-09-18T00:31:52.881 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2081 2024-09-18T00:31:52.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.882 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446696+0000", 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446696+0000", 2024-09-18T00:31:52.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446697+0000", 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.33e-06 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446703+0000", 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4670000000000001e-06 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446718+0000", 2024-09-18T00:31:52.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.417e-05 2024-09-18T00:31:52.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446726+0000", 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5089999999999993e-06 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446780+0000", 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4308999999999998e-05 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.446934+0000", 2024-09-18T00:31:52.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015363599999999999 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.447140+0000", 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020562099999999999 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.451370+0000", 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042300530000000001 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.451593+0000", 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022327100000000001 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.451650+0000", 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6647999999999997e-05 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.451691+0000", 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0942999999999997e-05 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2155 3.19 3:9b3c50b2:::rbd_data.1197f1330e07.000000000000019d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 237568~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.505112+0000", 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.34116870799999999, 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041505120000000003, 2024-09-18T00:31:52.890 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2155 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505112+0000", 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505112+0000", 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505114+0000", 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505131+0000", 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7075000000000002e-05 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505150+0000", 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9049e-05 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505160+0000", 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0005e-05 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505232+0000", 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2527999999999994e-05 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505420+0000", 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018739200000000001 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.505627+0000", 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000206889 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.507071+0000", 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001444196 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.509173+0000", 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002102104 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.509218+0000", 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5361000000000002e-05 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.509262+0000", 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3668999999999998e-05 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2194 3.4 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 243712~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.534267+0000", 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.31201335899999999, 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056743710000000001, 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2194 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534267+0000", 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534267+0000", 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534268+0000", 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.513e-06 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534276+0000", 2024-09-18T00:31:52.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534289+0000", 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3256e-05 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534296+0000", 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3579999999999997e-06 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534364+0000", 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7318999999999997e-05 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534497+0000", 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000133595 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534677+0000", 2024-09-18T00:31:52.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018014999999999999 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.537198+0000", 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025203579999999999 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539805+0000", 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002607622 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539893+0000", 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7293999999999995e-05 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539941+0000", 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8479999999999997e-05 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2196 3.1a e29/23 3:58c65b88:::rbd_data.1197f1330e07.000000000000007b:head v 29'28, mlcod=29'25)", 2024-09-18T00:31:52.903 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535845+0000", 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.31043501299999998, 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042127880000000003, 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535845+0000", 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535845+0000", 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535846+0000", 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3200000000000004e-07 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535854+0000", 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8029999999999997e-06 2024-09-18T00:31:52.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535866+0000", 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1816e-05 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535874+0000", 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535921+0000", 2024-09-18T00:31:52.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6369999999999998e-05 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535941+0000", 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0307999999999999e-05 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.540021+0000", 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040797339999999998 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.540058+0000", 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2307 3.19 3:9ee403a5:::rbd_data.1197f1330e07.000000000000015a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 227328~2048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.609305+0000", 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.23697485099999999, 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006138442, 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2307 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609305+0000", 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609305+0000", 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609306+0000", 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0920000000000001e-06 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609313+0000", 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3910000000000003e-06 2024-09-18T00:31:52.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609326+0000", 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3576e-05 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609334+0000", 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4830000000000002e-06 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609397+0000", 2024-09-18T00:31:52.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2768000000000006e-05 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609500+0000", 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010327600000000001 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.609661+0000", 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016105000000000001 2024-09-18T00:31:52.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.612424+0000", 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002762825 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.615361+0000", 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029367600000000001 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.615405+0000", 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4435999999999999e-05 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.615444+0000", 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8785000000000002e-05 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2411 3.19 3:9a27b6ce:::rbd_data.1197f1330e07.00000000000000a3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.677133+0000", 2024-09-18T00:31:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16914732699999999, 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004959888, 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2411 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677133+0000", 2024-09-18T00:31:52.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677133+0000", 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677133+0000", 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2399999999999998e-07 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677137+0000", 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1719999999999999e-06 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677144+0000", 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3969999999999997e-06 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677150+0000", 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2910000000000004e-06 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677203+0000", 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3201000000000001e-05 2024-09-18T00:31:52.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677319+0000", 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115534 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677426+0000", 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010712700000000001 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681711+0000", 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004284726 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681991+0000", 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028010399999999999 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.682045+0000", 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3565e-05 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.682093+0000", 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8247000000000001e-05 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2406 3.6 e29/23 3:67a281cf:::rbd_data.1197f1330e07.000000000000009e:head v 29'20, mlcod=29'18)", 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.677489+0000", 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16879132199999999, 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042744059999999997, 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677489+0000", 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677489+0000", 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677490+0000", 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2839999999999999e-06 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677499+0000", 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8119999999999997e-06 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677511+0000", 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2036e-05 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677518+0000", 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0099999999999998e-06 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677595+0000", 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6835999999999994e-05 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677616+0000", 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1163999999999999e-05 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681720+0000", 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041042250000000004 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681763+0000", 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3038999999999999e-05 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2405 3.8 e29/23 3:15e3a210:::rbd_data.1197f1330e07.000000000000009d:head v 29'17, mlcod=29'15)", 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.677786+0000", 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.168494433, 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041018000000000001, 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677786+0000", 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677786+0000", 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677786+0000", 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7100000000000002e-07 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677793+0000", 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.584e-06 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677801+0000", 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0250000000000002e-06 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677807+0000", 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5709999999999997e-06 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677860+0000", 2024-09-18T00:31:52.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3455000000000002e-05 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677884+0000", 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3541999999999999e-05 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681845+0000", 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039610160000000004 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681888+0000", 2024-09-18T00:31:52.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3035999999999999e-05 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2413 3.0 3:01033e15:::rbd_data.1197f1330e07.00000000000000a5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.678592+0000", 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16768867600000001, 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005915315, 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2413 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678592+0000", 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678592+0000", 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678593+0000", 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1149999999999999e-06 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678597+0000", 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4190000000000004e-06 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678607+0000", 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0346000000000001e-05 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678612+0000", 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0130000000000001e-06 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678658+0000", 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5179000000000002e-05 2024-09-18T00:31:52.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678751+0000", 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3679999999999998e-05 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678856+0000", 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104814 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681975+0000", 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031192279999999999 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684419+0000", 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024436150000000001 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684467+0000", 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8433000000000002e-05 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684507+0000", 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9473e-05 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2414 3.0 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.938 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679242+0000", 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.167037879, 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058767450000000001, 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2414 2024-09-18T00:31:52.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679242+0000", 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679242+0000", 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679243+0000", 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9199999999999999e-07 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679248+0000", 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.493e-06 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679259+0000", 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1287000000000001e-05 2024-09-18T00:31:52.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679266+0000", 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.443e-06 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679322+0000", 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6901000000000003e-05 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679400+0000", 2024-09-18T00:31:52.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181999999999994e-05 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679479+0000", 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9457999999999997e-05 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684516+0000", 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050364709999999998 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.685028+0000", 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000512704 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.685079+0000", 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1168999999999997e-05 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.685119+0000", 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9644999999999997e-05 2024-09-18T00:31:52.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2468 3.19 3:9a43b6ca:::rbd_data.1197f1330e07.0000000000000215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.701018+0000", 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.14526239399999999, 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064796999999999997, 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2468 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701018+0000", 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701018+0000", 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701019+0000", 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1999999999999998e-07 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701024+0000", 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4219999999999999e-06 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701050+0000", 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6083000000000001e-05 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701058+0000", 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8059999999999995e-06 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701101+0000", 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3251999999999999e-05 2024-09-18T00:31:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701148+0000", 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701208+0000", 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9809000000000003e-05 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701622+0000", 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041401900000000001 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707410+0000", 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057880800000000001 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707455+0000", 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5550999999999998e-05 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707498+0000", 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2209000000000002e-05 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2470 3.19 3:99c3af6a:::rbd_data.1197f1330e07.000000000000021d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.701759+0000", 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.14452108699999999, 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00591897, 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2470 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701759+0000", 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701759+0000", 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701760+0000", 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0160000000000001e-06 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701765+0000", 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9899999999999997e-06 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701779+0000", 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3446e-05 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701787+0000", 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.994e-06 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701849+0000", 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2774999999999994e-05 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.701943+0000", 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3540000000000002e-05 2024-09-18T00:31:52.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.702050+0000", 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010725700000000001 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.702611+0000", 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056131900000000001 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707594+0000", 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049828620000000002 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707642+0000", 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8149999999999998e-05 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707678+0000", 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5621000000000003e-05 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2481 3.19 3:9e557e3e:::rbd_data.1197f1330e07.0000000000000236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.706862+0000", 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.13941840999999999, 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005216498, 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2481 2024-09-18T00:31:52.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706862+0000", 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706862+0000", 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706863+0000", 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8400000000000003e-07 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706867+0000", 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.583e-06 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706886+0000", 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8376000000000002e-05 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706893+0000", 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0169999999999999e-06 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.706945+0000", 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2197000000000002e-05 2024-09-18T00:31:52.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707023+0000", 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8614000000000003e-05 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707128+0000", 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010509999999999999 2024-09-18T00:31:52.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707690+0000", 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056167299999999995 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.711981+0000", 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042909419999999998 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.712037+0000", 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5951e-05 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.712078+0000", 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1260999999999997e-05 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2507 3.8 e29/23 3:160ef29e:::rbd_data.1197f1330e07.00000000000002dc:head v 29'22, mlcod=29'20)", 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.715478+0000", 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.13080186599999999, 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041657530000000003, 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715478+0000", 2024-09-18T00:31:52.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715478+0000", 2024-09-18T00:31:52.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715479+0000", 2024-09-18T00:31:52.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6199999999999997e-07 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715486+0000", 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.63e-06 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715496+0000", 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0028e-05 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715502+0000", 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3709999999999996e-06 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715635+0000", 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132531 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.715653+0000", 2024-09-18T00:31:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8890999999999999e-05 2024-09-18T00:31:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.719606+0000", 2024-09-18T00:31:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039526910000000004 2024-09-18T00:31:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.719644+0000", 2024-09-18T00:31:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7948999999999999e-05 2024-09-18T00:31:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2521 3.19 3:9cbd002e:::rbd_data.1197f1330e07.0000000000000330:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.720019+0000", 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.12626132100000001, 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052557339999999998, 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2521 2024-09-18T00:31:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720019+0000", 2024-09-18T00:31:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720019+0000", 2024-09-18T00:31:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720020+0000", 2024-09-18T00:31:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9500000000000001e-07 2024-09-18T00:31:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720024+0000", 2024-09-18T00:31:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0409999999999999e-06 2024-09-18T00:31:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720035+0000", 2024-09-18T00:31:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.097e-05 2024-09-18T00:31:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720042+0000", 2024-09-18T00:31:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.092e-06 2024-09-18T00:31:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720098+0000", 2024-09-18T00:31:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6468000000000002e-05 2024-09-18T00:31:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720149+0000", 2024-09-18T00:31:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0467999999999999e-05 2024-09-18T00:31:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-18T00:31:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720239+0000", 2024-09-18T00:31:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9954e-05 2024-09-18T00:31:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.724735+0000", 2024-09-18T00:31:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044959190000000001 2024-09-18T00:31:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.725176+0000", 2024-09-18T00:31:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00044163900000000002 2024-09-18T00:31:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.725230+0000", 2024-09-18T00:31:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3523999999999998e-05 2024-09-18T00:31:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.725275+0000", 2024-09-18T00:31:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4764e-05 2024-09-18T00:31:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2518 3.8 e29/23 3:119a4585:::rbd_data.1197f1330e07.000000000000032d:head v 29'23, mlcod=29'21)", 2024-09-18T00:31:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.720220+0000", 2024-09-18T00:31:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.12606063000000001, 2024-09-18T00:31:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045617399999999999, 2024-09-18T00:31:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720220+0000", 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720220+0000", 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720220+0000", 2024-09-18T00:31:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3300000000000001e-07 2024-09-18T00:31:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720226+0000", 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720237+0000", 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0291e-05 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720246+0000", 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2490000000000007e-06 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720290+0000", 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3679e-05 2024-09-18T00:31:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.720307+0000", 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7479999999999999e-05 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.724737+0000", 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044294750000000004 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.724781+0000", 2024-09-18T00:31:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4812999999999999e-05 2024-09-18T00:31:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:52.995 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:52.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:31:52.997 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T00:31:52.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T00:31:52.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:31:52.998 INFO:teuthology.orchestra.run.smithi081.stdout:304 read 0x1529b8 thru 0x1551ea (0x2833 bytes) 2024-09-18T00:31:52.999 INFO:teuthology.orchestra.run.smithi081.stdout:305 write 0x5469f30 thru 0x5474051 (0xa122 bytes) 2024-09-18T00:31:52.999 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:52.999 INFO:teuthology.orchestra.run.smithi081.stdout:307 read 0x26d8a84 thru 0x26dfa1e (0x6f9b bytes) 2024-09-18T00:31:52.999 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:52.994+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:53.005 INFO:teuthology.orchestra.run.smithi081.stdout:308 write 0x81c56bd thru 0x81d3880 (0xe1c4 bytes) 2024-09-18T00:31:53.022 INFO:teuthology.orchestra.run.smithi081.stdout:309 write 0x6ff5b4a thru 0x6ff751b (0x19d2 bytes) 2024-09-18T00:31:53.028 INFO:teuthology.orchestra.run.smithi081.stdout:310 writesame 0x77d14b2 thru 0x77d9d19 data_size 0x3c(0x8868 bytes) 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:311 punch from 0x52878bb to 0x5290b5f, (0x92a4 bytes) 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:312 punch from 0x306e77c to 0x306f31f, (0xba3 bytes) 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:314 read 0x6b14694 thru 0x6b147b0 (0x11d bytes) 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:318 punch from 0x2e6ca6d to 0x2e73c57, (0x71ea bytes) 2024-09-18T00:31:53.048 INFO:teuthology.orchestra.run.smithi081.stdout:319 clone 3 order 19 su 4096 sc 15 2024-09-18T00:31:53.097 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:53.095+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:53.120 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:53.121 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:53.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:31:53.215 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:53.214+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:53.277 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:53.278 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:53.278 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:53.278 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:53.278 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:53.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:31:53.299 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:53.297+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:53.305 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:31:53.317 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-18T00:31:53.041419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3016930,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":168,"num_read_kb":141,"num_write":191,"num_write_kb":2778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2276,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2330624,"data_stored":2007731,"data_compressed":17609,"data_compressed_allocated":81920,"data_compressed_original":1159168,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2426543,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":52,"num_read_kb":41,"num_write":30,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000515"},"pg_stats":[{"pgid":"3.1f","version":"28'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.985442+0000","last_change":"2024-09-18T00:31:48.867189+0000","last_active":"2024-09-18T00:31:51.985442+0000","last_peered":"2024-09-18T00:31:51.985442+0000","last_clean":"2024-09-18T00:31:51.985442+0000","last_became_active":"2024-09-18T00:31:46.857203+0000","last_became_peered":"2024-09-18T00:31:46.857203+0000","last_unstale":"2024-09-18T00:31:51.985442+0000","last_undegraded":"2024-09-18T00:31:51.985442+0000","last_fullsized":"2024-09-18T00:31:51.985442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:59:48.587729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011431729999999999,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":5,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986506+0000","last_change":"2024-09-18T00:31:48.986506+0000","last_active":"2024-09-18T00:31:48.986506+0000","last_peered":"2024-09-18T00:31:48.986506+0000","last_clean":"2024-09-18T00:31:48.986506+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:31:48.986506+0000","last_undegraded":"2024-09-18T00:31:48.986506+0000","last_fullsized":"2024-09-18T00:31:48.986506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:06.942562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078236600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.858463+0000","last_change":"2024-09-18T00:31:48.858463+0000","last_active":"2024-09-18T00:31:48.858463+0000","last_peered":"2024-09-18T00:31:48.858463+0000","last_clean":"2024-09-18T00:31:48.858463+0000","last_became_active":"2024-09-18T00:31:46.855003+0000","last_became_peered":"2024-09-18T00:31:46.855003+0000","last_unstale":"2024-09-18T00:31:48.858463+0000","last_undegraded":"2024-09-18T00:31:48.858463+0000","last_fullsized":"2024-09-18T00:31:48.858463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:28.285373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048435299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.863921+0000","last_change":"2024-09-18T00:31:48.858226+0000","last_active":"2024-09-18T00:31:48.863921+0000","last_peered":"2024-09-18T00:31:48.863921+0000","last_clean":"2024-09-18T00:31:48.863921+0000","last_became_active":"2024-09-18T00:31:46.854720+0000","last_became_peered":"2024-09-18T00:31:46.854720+0000","last_unstale":"2024-09-18T00:31:48.863921+0000","last_undegraded":"2024-09-18T00:31:48.863921+0000","last_fullsized":"2024-09-18T00:31:48.863921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:58.054840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039719499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.909995+0000","last_change":"2024-09-18T00:31:48.867301+0000","last_active":"2024-09-18T00:31:51.909995+0000","last_peered":"2024-09-18T00:31:51.909995+0000","last_clean":"2024-09-18T00:31:51.909995+0000","last_became_active":"2024-09-18T00:31:46.859322+0000","last_became_peered":"2024-09-18T00:31:46.859322+0000","last_unstale":"2024-09-18T00:31:51.909995+0000","last_undegraded":"2024-09-18T00:31:51.909995+0000","last_fullsized":"2024-09-18T00:31:51.909995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:35.607297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012412110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"26'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859631+0000","last_change":"2024-09-18T00:31:48.860421+0000","last_active":"2024-09-18T00:31:49.859631+0000","last_peered":"2024-09-18T00:31:49.859631+0000","last_clean":"2024-09-18T00:31:49.859631+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:31:49.859631+0000","last_undegraded":"2024-09-18T00:31:49.859631+0000","last_fullsized":"2024-09-18T00:31:49.859631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:58.153212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089020699999999996,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856620+0000","last_change":"2024-09-18T00:31:48.856023+0000","last_active":"2024-09-18T00:31:49.856620+0000","last_peered":"2024-09-18T00:31:49.856620+0000","last_clean":"2024-09-18T00:31:49.856620+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:31:49.856620+0000","last_undegraded":"2024-09-18T00:31:49.856620+0000","last_fullsized":"2024-09-18T00:31:49.856620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:23.906370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050127899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986343+0000","last_change":"2024-09-18T00:31:48.986343+0000","last_active":"2024-09-18T00:31:48.986343+0000","last_peered":"2024-09-18T00:31:48.986343+0000","last_clean":"2024-09-18T00:31:48.986343+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:31:48.986343+0000","last_undegraded":"2024-09-18T00:31:48.986343+0000","last_fullsized":"2024-09-18T00:31:48.986343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:24:34.531169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065419800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"28'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.910114+0000","last_change":"2024-09-18T00:31:48.867375+0000","last_active":"2024-09-18T00:31:51.910114+0000","last_peered":"2024-09-18T00:31:51.910114+0000","last_clean":"2024-09-18T00:31:51.910114+0000","last_became_active":"2024-09-18T00:31:46.858297+0000","last_became_peered":"2024-09-18T00:31:46.858297+0000","last_unstale":"2024-09-18T00:31:51.910114+0000","last_undegraded":"2024-09-18T00:31:51.910114+0000","last_fullsized":"2024-09-18T00:31:51.910114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:17.361440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012184100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.870949+0000","last_change":"2024-09-18T00:31:48.858308+0000","last_active":"2024-09-18T00:31:48.870949+0000","last_peered":"2024-09-18T00:31:48.870949+0000","last_clean":"2024-09-18T00:31:48.870949+0000","last_became_active":"2024-09-18T00:31:46.851617+0000","last_became_peered":"2024-09-18T00:31:46.851617+0000","last_unstale":"2024-09-18T00:31:48.870949+0000","last_undegraded":"2024-09-18T00:31:48.870949+0000","last_fullsized":"2024-09-18T00:31:48.870949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:02:21.471449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035842399999999998,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871844+0000","last_change":"2024-09-18T00:31:48.871844+0000","last_active":"2024-09-18T00:31:48.871844+0000","last_peered":"2024-09-18T00:31:48.871844+0000","last_clean":"2024-09-18T00:31:48.871844+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:31:48.871844+0000","last_undegraded":"2024-09-18T00:31:48.871844+0000","last_fullsized":"2024-09-18T00:31:48.871844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:35:37.842354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037964800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859591+0000","last_change":"2024-09-18T00:31:48.860473+0000","last_active":"2024-09-18T00:31:49.859591+0000","last_peered":"2024-09-18T00:31:49.859591+0000","last_clean":"2024-09-18T00:31:49.859591+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:31:49.859591+0000","last_undegraded":"2024-09-18T00:31:49.859591+0000","last_fullsized":"2024-09-18T00:31:49.859591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:51:22.310662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090479700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985374+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:31:48.985374+0000","last_peered":"2024-09-18T00:31:48.985374+0000","last_clean":"2024-09-18T00:31:48.985374+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:31:48.985374+0000","last_undegraded":"2024-09-18T00:31:48.985374+0000","last_fullsized":"2024-09-18T00:31:48.985374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.948569+0000","last_change":"2024-09-18T00:31:48.867043+0000","last_active":"2024-09-18T00:31:51.948569+0000","last_peered":"2024-09-18T00:31:51.948569+0000","last_clean":"2024-09-18T00:31:51.948569+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:31:51.948569+0000","last_undegraded":"2024-09-18T00:31:51.948569+0000","last_fullsized":"2024-09-18T00:31:51.948569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:29:29.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010540840000000001,"stat_sum":{"num_bytes":1377902,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":12,"num_read_kb":14,"num_write":11,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856950+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:31:49.856950+0000","last_peered":"2024-09-18T00:31:49.856950+0000","last_clean":"2024-09-18T00:31:49.856950+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:31:49.856950+0000","last_undegraded":"2024-09-18T00:31:49.856950+0000","last_fullsized":"2024-09-18T00:31:49.856950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986721+0000","last_change":"2024-09-18T00:31:48.986721+0000","last_active":"2024-09-18T00:31:48.986721+0000","last_peered":"2024-09-18T00:31:48.986721+0000","last_clean":"2024-09-18T00:31:48.986721+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:31:48.986721+0000","last_undegraded":"2024-09-18T00:31:48.986721+0000","last_fullsized":"2024-09-18T00:31:48.986721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:38.681932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094052899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871599+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:31:48.871599+0000","last_peered":"2024-09-18T00:31:48.871599+0000","last_clean":"2024-09-18T00:31:48.871599+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:31:48.871599+0000","last_undegraded":"2024-09-18T00:31:48.871599+0000","last_fullsized":"2024-09-18T00:31:48.871599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856733+0000","last_change":"2024-09-18T00:31:48.855715+0000","last_active":"2024-09-18T00:31:49.856733+0000","last_peered":"2024-09-18T00:31:49.856733+0000","last_clean":"2024-09-18T00:31:49.856733+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:31:49.856733+0000","last_undegraded":"2024-09-18T00:31:49.856733+0000","last_fullsized":"2024-09-18T00:31:49.856733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:14:55.903934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028487899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856784+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:31:49.856784+0000","last_peered":"2024-09-18T00:31:49.856784+0000","last_clean":"2024-09-18T00:31:49.856784+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:31:49.856784+0000","last_undegraded":"2024-09-18T00:31:49.856784+0000","last_fullsized":"2024-09-18T00:31:49.856784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.858535+0000","last_change":"2024-09-18T00:31:48.858535+0000","last_active":"2024-09-18T00:31:48.858535+0000","last_peered":"2024-09-18T00:31:48.858535+0000","last_clean":"2024-09-18T00:31:48.858535+0000","last_became_active":"2024-09-18T00:31:46.852261+0000","last_became_peered":"2024-09-18T00:31:46.852261+0000","last_unstale":"2024-09-18T00:31:48.858535+0000","last_undegraded":"2024-09-18T00:31:48.858535+0000","last_fullsized":"2024-09-18T00:31:48.858535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:56.589221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053830299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859604+0000","last_change":"2024-09-18T00:31:48.860661+0000","last_active":"2024-09-18T00:31:49.859604+0000","last_peered":"2024-09-18T00:31:49.859604+0000","last_clean":"2024-09-18T00:31:49.859604+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:31:49.859604+0000","last_undegraded":"2024-09-18T00:31:49.859604+0000","last_fullsized":"2024-09-18T00:31:49.859604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:58.012142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094755499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.857727+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:31:48.857727+0000","last_peered":"2024-09-18T00:31:48.857727+0000","last_clean":"2024-09-18T00:31:48.857727+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:31:48.857727+0000","last_undegraded":"2024-09-18T00:31:48.857727+0000","last_fullsized":"2024-09-18T00:31:48.857727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.857131+0000","last_change":"2024-09-18T00:31:48.855777+0000","last_active":"2024-09-18T00:31:49.857131+0000","last_peered":"2024-09-18T00:31:49.857131+0000","last_clean":"2024-09-18T00:31:49.857131+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:31:49.857131+0000","last_undegraded":"2024-09-18T00:31:49.857131+0000","last_fullsized":"2024-09-18T00:31:49.857131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:09.635631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032180899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.855143+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:31:48.855143+0000","last_peered":"2024-09-18T00:31:48.855143+0000","last_clean":"2024-09-18T00:31:48.855143+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:31:48.855143+0000","last_undegraded":"2024-09-18T00:31:48.855143+0000","last_fullsized":"2024-09-18T00:31:48.855143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.909952+0000","last_change":"2024-09-18T00:31:48.866306+0000","last_active":"2024-09-18T00:31:51.909952+0000","last_peered":"2024-09-18T00:31:51.909952+0000","last_clean":"2024-09-18T00:31:51.909952+0000","last_became_active":"2024-09-18T00:31:46.858165+0000","last_became_peered":"2024-09-18T00:31:46.858165+0000","last_unstale":"2024-09-18T00:31:51.909952+0000","last_undegraded":"2024-09-18T00:31:51.909952+0000","last_fullsized":"2024-09-18T00:31:51.909952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:39.063673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054274200000000003,"stat_sum":{"num_bytes":1048576,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871285+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:31:48.871285+0000","last_peered":"2024-09-18T00:31:48.871285+0000","last_clean":"2024-09-18T00:31:48.871285+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:31:48.871285+0000","last_undegraded":"2024-09-18T00:31:48.871285+0000","last_fullsized":"2024-09-18T00:31:48.871285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985967+0000","last_change":"2024-09-18T00:31:48.985967+0000","last_active":"2024-09-18T00:31:48.985967+0000","last_peered":"2024-09-18T00:31:48.985967+0000","last_clean":"2024-09-18T00:31:48.985967+0000","last_became_active":"2024-09-18T00:31:46.853986+0000","last_became_peered":"2024-09-18T00:31:46.853986+0000","last_unstale":"2024-09-18T00:31:48.985967+0000","last_undegraded":"2024-09-18T00:31:48.985967+0000","last_fullsized":"2024-09-18T00:31:48.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:44.384068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043793499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.857738+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:31:48.857738+0000","last_peered":"2024-09-18T00:31:48.857738+0000","last_clean":"2024-09-18T00:31:48.857738+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:31:48.857738+0000","last_undegraded":"2024-09-18T00:31:48.857738+0000","last_fullsized":"2024-09-18T00:31:48.857738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871293+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:31:48.871293+0000","last_peered":"2024-09-18T00:31:48.871293+0000","last_clean":"2024-09-18T00:31:48.871293+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:31:48.871293+0000","last_undegraded":"2024-09-18T00:31:48.871293+0000","last_fullsized":"2024-09-18T00:31:48.871293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986780+0000","last_change":"2024-09-18T00:31:48.986780+0000","last_active":"2024-09-18T00:31:48.986780+0000","last_peered":"2024-09-18T00:31:48.986780+0000","last_clean":"2024-09-18T00:31:48.986780+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:31:48.986780+0000","last_undegraded":"2024-09-18T00:31:48.986780+0000","last_fullsized":"2024-09-18T00:31:48.986780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:05.123425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092255199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859484+0000","last_change":"2024-09-18T00:31:48.859894+0000","last_active":"2024-09-18T00:31:49.859484+0000","last_peered":"2024-09-18T00:31:49.859484+0000","last_clean":"2024-09-18T00:31:49.859484+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:31:49.859484+0000","last_undegraded":"2024-09-18T00:31:49.859484+0000","last_fullsized":"2024-09-18T00:31:49.859484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:01.277524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037794800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985698+0000","last_change":"2024-09-18T00:31:48.985698+0000","last_active":"2024-09-18T00:31:48.985698+0000","last_peered":"2024-09-18T00:31:48.985698+0000","last_clean":"2024-09-18T00:31:48.985698+0000","last_became_active":"2024-09-18T00:31:46.855822+0000","last_became_peered":"2024-09-18T00:31:46.855822+0000","last_unstale":"2024-09-18T00:31:48.985698+0000","last_undegraded":"2024-09-18T00:31:48.985698+0000","last_fullsized":"2024-09-18T00:31:48.985698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:21.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030723799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986238+0000","last_change":"2024-09-18T00:31:48.986238+0000","last_active":"2024-09-18T00:31:48.986238+0000","last_peered":"2024-09-18T00:31:48.986238+0000","last_clean":"2024-09-18T00:31:48.986238+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:31:48.986238+0000","last_undegraded":"2024-09-18T00:31:48.986238+0000","last_fullsized":"2024-09-18T00:31:48.986238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:21.598882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063642199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.858730+0000","last_change":"2024-09-18T00:31:48.858730+0000","last_active":"2024-09-18T00:31:48.858730+0000","last_peered":"2024-09-18T00:31:48.858730+0000","last_clean":"2024-09-18T00:31:48.858730+0000","last_became_active":"2024-09-18T00:31:46.851057+0000","last_became_peered":"2024-09-18T00:31:46.851057+0000","last_unstale":"2024-09-18T00:31:48.858730+0000","last_undegraded":"2024-09-18T00:31:48.858730+0000","last_fullsized":"2024-09-18T00:31:48.858730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:40.286961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069353299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.872219+0000","last_change":"2024-09-18T00:31:48.872219+0000","last_active":"2024-09-18T00:31:48.872219+0000","last_peered":"2024-09-18T00:31:48.872219+0000","last_clean":"2024-09-18T00:31:48.872219+0000","last_became_active":"2024-09-18T00:31:46.853922+0000","last_became_peered":"2024-09-18T00:31:46.853922+0000","last_unstale":"2024-09-18T00:31:48.872219+0000","last_undegraded":"2024-09-18T00:31:48.872219+0000","last_fullsized":"2024-09-18T00:31:48.872219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:34.088581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063734100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871997+0000","last_change":"2024-09-18T00:31:48.871997+0000","last_active":"2024-09-18T00:31:48.871997+0000","last_peered":"2024-09-18T00:31:48.871997+0000","last_clean":"2024-09-18T00:31:48.871997+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:31:48.871997+0000","last_undegraded":"2024-09-18T00:31:48.871997+0000","last_fullsized":"2024-09-18T00:31:48.871997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:40:41.342320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.872116+0000","last_change":"2024-09-18T00:31:48.872116+0000","last_active":"2024-09-18T00:31:48.872116+0000","last_peered":"2024-09-18T00:31:48.872116+0000","last_clean":"2024-09-18T00:31:48.872116+0000","last_became_active":"2024-09-18T00:31:46.858825+0000","last_became_peered":"2024-09-18T00:31:46.858825+0000","last_unstale":"2024-09-18T00:31:48.872116+0000","last_undegraded":"2024-09-18T00:31:48.872116+0000","last_fullsized":"2024-09-18T00:31:48.872116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:03.653535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057934999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985662+0000","last_change":"2024-09-18T00:31:48.985662+0000","last_active":"2024-09-18T00:31:48.985662+0000","last_peered":"2024-09-18T00:31:48.985662+0000","last_clean":"2024-09-18T00:31:48.985662+0000","last_became_active":"2024-09-18T00:31:46.856661+0000","last_became_peered":"2024-09-18T00:31:46.856661+0000","last_unstale":"2024-09-18T00:31:48.985662+0000","last_undegraded":"2024-09-18T00:31:48.985662+0000","last_fullsized":"2024-09-18T00:31:48.985662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:01.194442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027370699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871732+0000","last_change":"2024-09-18T00:31:48.871732+0000","last_active":"2024-09-18T00:31:48.871732+0000","last_peered":"2024-09-18T00:31:48.871732+0000","last_clean":"2024-09-18T00:31:48.871732+0000","last_became_active":"2024-09-18T00:31:46.858556+0000","last_became_peered":"2024-09-18T00:31:46.858556+0000","last_unstale":"2024-09-18T00:31:48.871732+0000","last_undegraded":"2024-09-18T00:31:48.871732+0000","last_fullsized":"2024-09-18T00:31:48.871732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:12:53.342821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035443699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"28'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.909816+0000","last_change":"2024-09-18T00:31:48.866261+0000","last_active":"2024-09-18T00:31:51.909816+0000","last_peered":"2024-09-18T00:31:51.909816+0000","last_clean":"2024-09-18T00:31:51.909816+0000","last_became_active":"2024-09-18T00:31:46.858545+0000","last_became_peered":"2024-09-18T00:31:46.858545+0000","last_unstale":"2024-09-18T00:31:51.909816+0000","last_undegraded":"2024-09-18T00:31:51.909816+0000","last_fullsized":"2024-09-18T00:31:51.909816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:28:02.398886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047466899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.872343+0000","last_change":"2024-09-18T00:31:48.872343+0000","last_active":"2024-09-18T00:31:48.872343+0000","last_peered":"2024-09-18T00:31:48.872343+0000","last_clean":"2024-09-18T00:31:48.872343+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:31:48.872343+0000","last_undegraded":"2024-09-18T00:31:48.872343+0000","last_fullsized":"2024-09-18T00:31:48.872343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:19.751260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066573000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2426543,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":52,"num_read_kb":41,"num_write":30,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":23698,"data_compressed":35,"data_compressed_allocated":4096,"data_compressed_original":20480,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":331776,"data_stored":691790,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":101392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":101457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":101411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":258048,"data_stored":95189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":95189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":719873,"data_compressed":12668,"data_compressed_allocated":45056,"data_compressed_original":585728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":23584,"data_compressed":35,"data_compressed_allocated":4096,"data_compressed_original":20480,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":30,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:31:53.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:31:53.401 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:53.400+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:53.409 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4281.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.263530076999999, 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00093050499999999998, 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144154+0000", 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5600000000000005e-07 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144165+0000", 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1593000000000001e-05 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144174+0000", 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5809999999999997e-06 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144183+0000", 2024-09-18T00:31:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4790000000000002e-06 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144231+0000", 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7809000000000003e-05 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144258+0000", 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6301000000000001e-05 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.145041+0000", 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00078354599999999998 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.145084+0000", 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2540000000000003e-05 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:946 3.9 e29/23 3:9298583a:::rbd_data.1197f1330e07.000000000000027d:head v 29'48, mlcod=29'46)", 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.288734+0000", 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.118949349, 2024-09-18T00:31:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00089060599999999995, 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288734+0000", 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288734+0000", 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288735+0000", 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2640000000000001e-06 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288747+0000", 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1707e-05 2024-09-18T00:31:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288764+0000", 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7501999999999999e-05 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288774+0000", 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2560000000000008e-06 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288842+0000", 2024-09-18T00:31:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8329000000000003e-05 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.288867+0000", 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4966000000000001e-05 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.289578+0000", 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00071099300000000004 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.289624+0000", 2024-09-18T00:31:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6588999999999997e-05 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:995 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'50, mlcod=29'48)", 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.318726+0000", 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.08895724, 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024166359999999998, 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318726+0000", 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318726+0000", 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318727+0000", 2024-09-18T00:31:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1999999999999998e-07 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318733+0000", 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318746+0000", 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3008e-05 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318753+0000", 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2910000000000002e-06 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318807+0000", 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3690999999999998e-05 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318827+0000", 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0258000000000002e-05 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.321104+0000", 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022767320000000001 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.321143+0000", 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8597000000000003e-05 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:1002 3.0 e29/23 3:049b8f32:::rbd_data.1197f1330e07.0000000000000237:head v 29'6, mlcod=28'4)", 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.327422+0000", 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.0802610640000001, 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022624210000000001, 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327422+0000", 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327422+0000", 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327423+0000", 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0100000000000003e-07 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327443+0000", 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0288e-05 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327456+0000", 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2734e-05 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327464+0000", 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6389999999999992e-06 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327524+0000", 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0294000000000002e-05 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327547+0000", 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3455000000000002e-05 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329639+0000", 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020917539999999999 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329685+0000", 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5355999999999997e-05 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2051 3.4 e29/23 3:27d19dec:::rbd_data.1197f1330e07.000000000000003c:head v 29'10, mlcod=28'8)", 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.377755+0000", 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.029928419, 2024-09-18T00:31:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001108585, 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377755+0000", 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377755+0000", 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377756+0000", 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999999999999999e-06 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377842+0000", 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5609e-05 2024-09-18T00:31:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377856+0000", 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4099e-05 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377863+0000", 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5100000000000001e-06 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377921+0000", 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7853000000000003e-05 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377943+0000", 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2059e-05 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.378818+0000", 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087449999999999995 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.378863+0000", 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5754999999999998e-05 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.87253428, 2024-09-18T00:31:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:31:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2224 3.0 e29/23 3:01033e15:::rbd_data.1197f1330e07.00000000000000a5:head v 29'8, mlcod=29'6)", 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.557647+0000", 2024-09-18T00:31:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.85003616800000004, 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001049454, 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557647+0000", 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557647+0000", 2024-09-18T00:31:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557648+0000", 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.26e-06 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557668+0000", 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0163999999999999e-05 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557686+0000", 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7893999999999998e-05 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557695+0000", 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9430000000000006e-06 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557769+0000", 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3671000000000007e-05 2024-09-18T00:31:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557792+0000", 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3105e-05 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.558659+0000", 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00086652400000000003 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.558697+0000", 2024-09-18T00:31:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7892999999999998e-05 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2388 3.9 e29/23 3:948dfdcb:::rbd_data.1197f1330e07.00000000000001b3:head v 29'51, mlcod=29'49)", 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.646680+0000", 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.76100280300000001, 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016987879999999999, 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646680+0000", 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646680+0000", 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646682+0000", 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-06 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646692+0000", 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0576e-05 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646708+0000", 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5164000000000001e-05 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646715+0000", 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7770000000000002e-06 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646781+0000", 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.601e-05 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646807+0000", 2024-09-18T00:31:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6069000000000001e-05 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.648341+0000", 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001533981 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.648379+0000", 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7857e-05 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2402 3.4 e29/23 3:268cbbc0:::rbd_data.1197f1330e07.000000000000009a:head v 29'13, mlcod=29'11)", 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.677504+0000", 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.73017890100000005, 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014091030000000001, 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677504+0000", 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677504+0000", 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677506+0000", 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.632e-06 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677517+0000", 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1401e-05 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677538+0000", 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0642999999999999e-05 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677547+0000", 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2220000000000008e-06 2024-09-18T00:31:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677606+0000", 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8334000000000001e-05 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677626+0000", 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0866e-05 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678866+0000", 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012395419999999999 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678913+0000", 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7463000000000003e-05 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2413 3.0 e29/23 3:01033e15:::rbd_data.1197f1330e07.00000000000000a5:head v 29'11, mlcod=29'9)", 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.72856553099999999, 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002684512, 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3399999999999998e-07 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679126+0000", 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4039999999999998e-06 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679139+0000", 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2763e-05 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679146+0000", 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9970000000000001e-06 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679209+0000", 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3175000000000004e-05 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679230+0000", 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1319e-05 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681761+0000", 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025310900000000002 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681802+0000", 2024-09-18T00:31:53.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1029999999999998e-05 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.728147824, 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:31:53.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:31:53.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:31:53.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2424 3.0 e29/23 3:0295e385:::rbd_data.1197f1330e07.0000000000000158:head v 29'13, mlcod=29'10)", 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.684869+0000", 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.72281404199999999, 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024667030000000002, 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684869+0000", 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684869+0000", 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684870+0000", 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.06e-07 2024-09-18T00:31:53.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684880+0000", 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0000000000000001e-05 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684890+0000", 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7650000000000005e-06 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684896+0000", 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8939999999999998e-06 2024-09-18T00:31:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684935+0000", 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9613999999999997e-05 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684949+0000", 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.414e-05 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.687298+0000", 2024-09-18T00:31:53.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023490429999999999 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.687336+0000", 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7540999999999999e-05 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2454 3.9 e29/23 3:948dfdcb:::rbd_data.1197f1330e07.00000000000001b3:head v 29'52, mlcod=29'50)", 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.696670+0000", 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.71101308900000004, 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002079254, 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696670+0000", 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696670+0000", 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696671+0000", 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7000000000000003e-07 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696679+0000", 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9589999999999995e-06 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696690+0000", 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.059e-05 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696697+0000", 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0940000000000002e-06 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696755+0000", 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8425999999999999e-05 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696776+0000", 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0712000000000001e-05 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.698699+0000", 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019231459999999999 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.698749+0000", 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0457000000000002e-05 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:31:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.70283099500000001, 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:31:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:31:53.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:31:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2482 3.0 e29/23 3:049b8f32:::rbd_data.1197f1330e07.0000000000000237:head v 29'14, mlcod=29'12)", 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.707745+0000", 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.69993828599999997, 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016652259999999999, 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707745+0000", 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707745+0000", 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707746+0000", 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999995e-07 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707752+0000", 2024-09-18T00:31:53.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6900000000000003e-06 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707765+0000", 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.237e-05 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707771+0000", 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3539999999999996e-06 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707820+0000", 2024-09-18T00:31:53.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9166999999999999e-05 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707841+0000", 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0760000000000001e-05 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709370+0000", 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001529341 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709410+0000", 2024-09-18T00:31:53.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9808999999999998e-05 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2589 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'16, mlcod=29'14)", 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.755966+0000", 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.65171753399999999, 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022669000000000001, 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755966+0000", 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755966+0000", 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755967+0000", 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6199999999999996e-07 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755976+0000", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3889999999999994e-06 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755989+0000", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3441000000000001e-05 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755997+0000", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4220000000000003e-06 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.756064+0000", 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7669000000000006e-05 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.756087+0000", 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2609e-05 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.758181+0000", 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020937830000000001 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.758233+0000", 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1724999999999997e-05 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:4461 3.0 e30/23 3:0295e385:::rbd_data.1197f1330e07.0000000000000158:head v 30'16, mlcod=29'14)", 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.42106935600000001, 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031733740000000001, 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986615+0000", 2024-09-18T00:31:53.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.359e-06 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986626+0000", 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1136e-05 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986643+0000", 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986653+0000", 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9979999999999998e-06 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986718+0000", 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4527000000000001e-05 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986739+0000", 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0953000000000001e-05 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989736+0000", 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029969340000000001 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989787+0000", 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1598999999999998e-05 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.492 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:4490 3.4 e30/23 3:23c4ae19:::rbd_data.1197f1330e07.0000000000000206:head v 30'18, mlcod=29'16)", 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.008632+0000", 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.39905168600000002, 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00084529699999999995, 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008632+0000", 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008632+0000", 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008633+0000", 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.37e-06 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008659+0000", 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5993999999999999e-05 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008678+0000", 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9004999999999998e-05 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008688+0000", 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6360000000000006e-06 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008765+0000", 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7200000000000006e-05 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.008790+0000", 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5508999999999999e-05 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.009426+0000", 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00063594900000000002 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.009477+0000", 2024-09-18T00:31:53.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0633999999999997e-05 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:4526 3.4 e30/23 3:26279e50:::rbd_data.1197f1330e07.00000000000001dc:head v 30'19, mlcod=30'17)", 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.031687+0000", 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.37599647800000002, 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00085295, 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.497 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031687+0000", 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031687+0000", 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031688+0000", 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3549999999999999e-06 2024-09-18T00:31:53.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031701+0000", 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2938e-05 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031718+0000", 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6753999999999999e-05 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031727+0000", 2024-09-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9360000000000005e-06 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031793+0000", 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5990999999999999e-05 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.031820+0000", 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7342e-05 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.032478+0000", 2024-09-18T00:31:53.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00065822500000000002 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.032540+0000", 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1408999999999994e-05 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:4529 3.4 e30/23 3:24cbe4a5:::rbd_data.1197f1330e07.00000000000001df:head v 30'20, mlcod=30'18)", 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.033756+0000", 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.37392766900000002, 2024-09-18T00:31:53.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00088078899999999999, 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033756+0000", 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033756+0000", 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033756+0000", 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033781+0000", 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5020000000000001e-05 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033793+0000", 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1446e-05 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033809+0000", 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6319000000000001e-05 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033914+0000", 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104811 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.033939+0000", 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4681e-05 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.034597+0000", 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00065856400000000005 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.034636+0000", 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9224000000000003e-05 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:53.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:31:53.507 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:53.505+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:53.607 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:53.606+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:31:53.643 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:31:53.651 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:31:53.651 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:53.654 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-18T00:31:53.041419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3016930,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":168,"num_read_kb":141,"num_write":191,"num_write_kb":2778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218536,"kb_used_data":2276,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756184,"statfs":{"total":773094113280,"available":772870332416,"internally_reserved":0,"allocated":2330624,"data_stored":2007731,"data_compressed":17609,"data_compressed_allocated":81920,"data_compressed_original":1159168,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2426543,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":52,"num_read_kb":41,"num_write":30,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000515"},"pg_stats":[{"pgid":"3.1f","version":"28'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.985442+0000","last_change":"2024-09-18T00:31:48.867189+0000","last_active":"2024-09-18T00:31:51.985442+0000","last_peered":"2024-09-18T00:31:51.985442+0000","last_clean":"2024-09-18T00:31:51.985442+0000","last_became_active":"2024-09-18T00:31:46.857203+0000","last_became_peered":"2024-09-18T00:31:46.857203+0000","last_unstale":"2024-09-18T00:31:51.985442+0000","last_undegraded":"2024-09-18T00:31:51.985442+0000","last_fullsized":"2024-09-18T00:31:51.985442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:59:48.587729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011431729999999999,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":5,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986506+0000","last_change":"2024-09-18T00:31:48.986506+0000","last_active":"2024-09-18T00:31:48.986506+0000","last_peered":"2024-09-18T00:31:48.986506+0000","last_clean":"2024-09-18T00:31:48.986506+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:31:48.986506+0000","last_undegraded":"2024-09-18T00:31:48.986506+0000","last_fullsized":"2024-09-18T00:31:48.986506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:23:06.942562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078236600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.858463+0000","last_change":"2024-09-18T00:31:48.858463+0000","last_active":"2024-09-18T00:31:48.858463+0000","last_peered":"2024-09-18T00:31:48.858463+0000","last_clean":"2024-09-18T00:31:48.858463+0000","last_became_active":"2024-09-18T00:31:46.855003+0000","last_became_peered":"2024-09-18T00:31:46.855003+0000","last_unstale":"2024-09-18T00:31:48.858463+0000","last_undegraded":"2024-09-18T00:31:48.858463+0000","last_fullsized":"2024-09-18T00:31:48.858463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:19:28.285373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048435299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.863921+0000","last_change":"2024-09-18T00:31:48.858226+0000","last_active":"2024-09-18T00:31:48.863921+0000","last_peered":"2024-09-18T00:31:48.863921+0000","last_clean":"2024-09-18T00:31:48.863921+0000","last_became_active":"2024-09-18T00:31:46.854720+0000","last_became_peered":"2024-09-18T00:31:46.854720+0000","last_unstale":"2024-09-18T00:31:48.863921+0000","last_undegraded":"2024-09-18T00:31:48.863921+0000","last_fullsized":"2024-09-18T00:31:48.863921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:12:58.054840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039719499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.909995+0000","last_change":"2024-09-18T00:31:48.867301+0000","last_active":"2024-09-18T00:31:51.909995+0000","last_peered":"2024-09-18T00:31:51.909995+0000","last_clean":"2024-09-18T00:31:51.909995+0000","last_became_active":"2024-09-18T00:31:46.859322+0000","last_became_peered":"2024-09-18T00:31:46.859322+0000","last_unstale":"2024-09-18T00:31:51.909995+0000","last_undegraded":"2024-09-18T00:31:51.909995+0000","last_fullsized":"2024-09-18T00:31:51.909995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:35.607297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012412110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"26'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859631+0000","last_change":"2024-09-18T00:31:48.860421+0000","last_active":"2024-09-18T00:31:49.859631+0000","last_peered":"2024-09-18T00:31:49.859631+0000","last_clean":"2024-09-18T00:31:49.859631+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:31:49.859631+0000","last_undegraded":"2024-09-18T00:31:49.859631+0000","last_fullsized":"2024-09-18T00:31:49.859631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:18:58.153212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089020699999999996,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":23,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856620+0000","last_change":"2024-09-18T00:31:48.856023+0000","last_active":"2024-09-18T00:31:49.856620+0000","last_peered":"2024-09-18T00:31:49.856620+0000","last_clean":"2024-09-18T00:31:49.856620+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:31:49.856620+0000","last_undegraded":"2024-09-18T00:31:49.856620+0000","last_fullsized":"2024-09-18T00:31:49.856620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:23.906370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050127899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986343+0000","last_change":"2024-09-18T00:31:48.986343+0000","last_active":"2024-09-18T00:31:48.986343+0000","last_peered":"2024-09-18T00:31:48.986343+0000","last_clean":"2024-09-18T00:31:48.986343+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:31:48.986343+0000","last_undegraded":"2024-09-18T00:31:48.986343+0000","last_fullsized":"2024-09-18T00:31:48.986343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:24:34.531169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065419800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"28'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.910114+0000","last_change":"2024-09-18T00:31:48.867375+0000","last_active":"2024-09-18T00:31:51.910114+0000","last_peered":"2024-09-18T00:31:51.910114+0000","last_clean":"2024-09-18T00:31:51.910114+0000","last_became_active":"2024-09-18T00:31:46.858297+0000","last_became_peered":"2024-09-18T00:31:46.858297+0000","last_unstale":"2024-09-18T00:31:51.910114+0000","last_undegraded":"2024-09-18T00:31:51.910114+0000","last_fullsized":"2024-09-18T00:31:51.910114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:58:17.361440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012184100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.870949+0000","last_change":"2024-09-18T00:31:48.858308+0000","last_active":"2024-09-18T00:31:48.870949+0000","last_peered":"2024-09-18T00:31:48.870949+0000","last_clean":"2024-09-18T00:31:48.870949+0000","last_became_active":"2024-09-18T00:31:46.851617+0000","last_became_peered":"2024-09-18T00:31:46.851617+0000","last_unstale":"2024-09-18T00:31:48.870949+0000","last_undegraded":"2024-09-18T00:31:48.870949+0000","last_fullsized":"2024-09-18T00:31:48.870949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:02:21.471449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035842399999999998,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871844+0000","last_change":"2024-09-18T00:31:48.871844+0000","last_active":"2024-09-18T00:31:48.871844+0000","last_peered":"2024-09-18T00:31:48.871844+0000","last_clean":"2024-09-18T00:31:48.871844+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:31:48.871844+0000","last_undegraded":"2024-09-18T00:31:48.871844+0000","last_fullsized":"2024-09-18T00:31:48.871844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:35:37.842354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037964800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859591+0000","last_change":"2024-09-18T00:31:48.860473+0000","last_active":"2024-09-18T00:31:49.859591+0000","last_peered":"2024-09-18T00:31:49.859591+0000","last_clean":"2024-09-18T00:31:49.859591+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:31:49.859591+0000","last_undegraded":"2024-09-18T00:31:49.859591+0000","last_fullsized":"2024-09-18T00:31:49.859591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:51:22.310662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090479700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985374+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:31:48.985374+0000","last_peered":"2024-09-18T00:31:48.985374+0000","last_clean":"2024-09-18T00:31:48.985374+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:31:48.985374+0000","last_undegraded":"2024-09-18T00:31:48.985374+0000","last_fullsized":"2024-09-18T00:31:48.985374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.948569+0000","last_change":"2024-09-18T00:31:48.867043+0000","last_active":"2024-09-18T00:31:51.948569+0000","last_peered":"2024-09-18T00:31:51.948569+0000","last_clean":"2024-09-18T00:31:51.948569+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:31:51.948569+0000","last_undegraded":"2024-09-18T00:31:51.948569+0000","last_fullsized":"2024-09-18T00:31:51.948569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:29:29.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010540840000000001,"stat_sum":{"num_bytes":1377902,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":12,"num_read_kb":14,"num_write":11,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856950+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:31:49.856950+0000","last_peered":"2024-09-18T00:31:49.856950+0000","last_clean":"2024-09-18T00:31:49.856950+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:31:49.856950+0000","last_undegraded":"2024-09-18T00:31:49.856950+0000","last_fullsized":"2024-09-18T00:31:49.856950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986721+0000","last_change":"2024-09-18T00:31:48.986721+0000","last_active":"2024-09-18T00:31:48.986721+0000","last_peered":"2024-09-18T00:31:48.986721+0000","last_clean":"2024-09-18T00:31:48.986721+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:31:48.986721+0000","last_undegraded":"2024-09-18T00:31:48.986721+0000","last_fullsized":"2024-09-18T00:31:48.986721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:38.681932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094052899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871599+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:31:48.871599+0000","last_peered":"2024-09-18T00:31:48.871599+0000","last_clean":"2024-09-18T00:31:48.871599+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:31:48.871599+0000","last_undegraded":"2024-09-18T00:31:48.871599+0000","last_fullsized":"2024-09-18T00:31:48.871599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856733+0000","last_change":"2024-09-18T00:31:48.855715+0000","last_active":"2024-09-18T00:31:49.856733+0000","last_peered":"2024-09-18T00:31:49.856733+0000","last_clean":"2024-09-18T00:31:49.856733+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:31:49.856733+0000","last_undegraded":"2024-09-18T00:31:49.856733+0000","last_fullsized":"2024-09-18T00:31:49.856733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:14:55.903934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028487899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.856784+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:31:49.856784+0000","last_peered":"2024-09-18T00:31:49.856784+0000","last_clean":"2024-09-18T00:31:49.856784+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:31:49.856784+0000","last_undegraded":"2024-09-18T00:31:49.856784+0000","last_fullsized":"2024-09-18T00:31:49.856784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.858535+0000","last_change":"2024-09-18T00:31:48.858535+0000","last_active":"2024-09-18T00:31:48.858535+0000","last_peered":"2024-09-18T00:31:48.858535+0000","last_clean":"2024-09-18T00:31:48.858535+0000","last_became_active":"2024-09-18T00:31:46.852261+0000","last_became_peered":"2024-09-18T00:31:46.852261+0000","last_unstale":"2024-09-18T00:31:48.858535+0000","last_undegraded":"2024-09-18T00:31:48.858535+0000","last_fullsized":"2024-09-18T00:31:48.858535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:52:56.589221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053830299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859604+0000","last_change":"2024-09-18T00:31:48.860661+0000","last_active":"2024-09-18T00:31:49.859604+0000","last_peered":"2024-09-18T00:31:49.859604+0000","last_clean":"2024-09-18T00:31:49.859604+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:31:49.859604+0000","last_undegraded":"2024-09-18T00:31:49.859604+0000","last_fullsized":"2024-09-18T00:31:49.859604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:21:58.012142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094755499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.857727+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:31:48.857727+0000","last_peered":"2024-09-18T00:31:48.857727+0000","last_clean":"2024-09-18T00:31:48.857727+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:31:48.857727+0000","last_undegraded":"2024-09-18T00:31:48.857727+0000","last_fullsized":"2024-09-18T00:31:48.857727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.857131+0000","last_change":"2024-09-18T00:31:48.855777+0000","last_active":"2024-09-18T00:31:49.857131+0000","last_peered":"2024-09-18T00:31:49.857131+0000","last_clean":"2024-09-18T00:31:49.857131+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:31:49.857131+0000","last_undegraded":"2024-09-18T00:31:49.857131+0000","last_fullsized":"2024-09-18T00:31:49.857131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:09.635631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032180899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.855143+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:31:48.855143+0000","last_peered":"2024-09-18T00:31:48.855143+0000","last_clean":"2024-09-18T00:31:48.855143+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:31:48.855143+0000","last_undegraded":"2024-09-18T00:31:48.855143+0000","last_fullsized":"2024-09-18T00:31:48.855143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.909952+0000","last_change":"2024-09-18T00:31:48.866306+0000","last_active":"2024-09-18T00:31:51.909952+0000","last_peered":"2024-09-18T00:31:51.909952+0000","last_clean":"2024-09-18T00:31:51.909952+0000","last_became_active":"2024-09-18T00:31:46.858165+0000","last_became_peered":"2024-09-18T00:31:46.858165+0000","last_unstale":"2024-09-18T00:31:51.909952+0000","last_undegraded":"2024-09-18T00:31:51.909952+0000","last_fullsized":"2024-09-18T00:31:51.909952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:39.063673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054274200000000003,"stat_sum":{"num_bytes":1048576,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871285+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:31:48.871285+0000","last_peered":"2024-09-18T00:31:48.871285+0000","last_clean":"2024-09-18T00:31:48.871285+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:31:48.871285+0000","last_undegraded":"2024-09-18T00:31:48.871285+0000","last_fullsized":"2024-09-18T00:31:48.871285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985967+0000","last_change":"2024-09-18T00:31:48.985967+0000","last_active":"2024-09-18T00:31:48.985967+0000","last_peered":"2024-09-18T00:31:48.985967+0000","last_clean":"2024-09-18T00:31:48.985967+0000","last_became_active":"2024-09-18T00:31:46.853986+0000","last_became_peered":"2024-09-18T00:31:46.853986+0000","last_unstale":"2024-09-18T00:31:48.985967+0000","last_undegraded":"2024-09-18T00:31:48.985967+0000","last_fullsized":"2024-09-18T00:31:48.985967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:44.384068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043793499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.857738+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:31:48.857738+0000","last_peered":"2024-09-18T00:31:48.857738+0000","last_clean":"2024-09-18T00:31:48.857738+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:31:48.857738+0000","last_undegraded":"2024-09-18T00:31:48.857738+0000","last_fullsized":"2024-09-18T00:31:48.857738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871293+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:31:48.871293+0000","last_peered":"2024-09-18T00:31:48.871293+0000","last_clean":"2024-09-18T00:31:48.871293+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:31:48.871293+0000","last_undegraded":"2024-09-18T00:31:48.871293+0000","last_fullsized":"2024-09-18T00:31:48.871293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986780+0000","last_change":"2024-09-18T00:31:48.986780+0000","last_active":"2024-09-18T00:31:48.986780+0000","last_peered":"2024-09-18T00:31:48.986780+0000","last_clean":"2024-09-18T00:31:48.986780+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:31:48.986780+0000","last_undegraded":"2024-09-18T00:31:48.986780+0000","last_fullsized":"2024-09-18T00:31:48.986780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:12:05.123425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092255199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-18T00:31:49.859484+0000","last_change":"2024-09-18T00:31:48.859894+0000","last_active":"2024-09-18T00:31:49.859484+0000","last_peered":"2024-09-18T00:31:49.859484+0000","last_clean":"2024-09-18T00:31:49.859484+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:31:49.859484+0000","last_undegraded":"2024-09-18T00:31:49.859484+0000","last_fullsized":"2024-09-18T00:31:49.859484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:01.277524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037794800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985698+0000","last_change":"2024-09-18T00:31:48.985698+0000","last_active":"2024-09-18T00:31:48.985698+0000","last_peered":"2024-09-18T00:31:48.985698+0000","last_clean":"2024-09-18T00:31:48.985698+0000","last_became_active":"2024-09-18T00:31:46.855822+0000","last_became_peered":"2024-09-18T00:31:46.855822+0000","last_unstale":"2024-09-18T00:31:48.985698+0000","last_undegraded":"2024-09-18T00:31:48.985698+0000","last_fullsized":"2024-09-18T00:31:48.985698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:21.776345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030723799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.986238+0000","last_change":"2024-09-18T00:31:48.986238+0000","last_active":"2024-09-18T00:31:48.986238+0000","last_peered":"2024-09-18T00:31:48.986238+0000","last_clean":"2024-09-18T00:31:48.986238+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:31:48.986238+0000","last_undegraded":"2024-09-18T00:31:48.986238+0000","last_fullsized":"2024-09-18T00:31:48.986238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:18:21.598882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063642199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.858730+0000","last_change":"2024-09-18T00:31:48.858730+0000","last_active":"2024-09-18T00:31:48.858730+0000","last_peered":"2024-09-18T00:31:48.858730+0000","last_clean":"2024-09-18T00:31:48.858730+0000","last_became_active":"2024-09-18T00:31:46.851057+0000","last_became_peered":"2024-09-18T00:31:46.851057+0000","last_unstale":"2024-09-18T00:31:48.858730+0000","last_undegraded":"2024-09-18T00:31:48.858730+0000","last_fullsized":"2024-09-18T00:31:48.858730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:19:40.286961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069353299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.872219+0000","last_change":"2024-09-18T00:31:48.872219+0000","last_active":"2024-09-18T00:31:48.872219+0000","last_peered":"2024-09-18T00:31:48.872219+0000","last_clean":"2024-09-18T00:31:48.872219+0000","last_became_active":"2024-09-18T00:31:46.853922+0000","last_became_peered":"2024-09-18T00:31:46.853922+0000","last_unstale":"2024-09-18T00:31:48.872219+0000","last_undegraded":"2024-09-18T00:31:48.872219+0000","last_fullsized":"2024-09-18T00:31:48.872219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:34.088581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063734100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871997+0000","last_change":"2024-09-18T00:31:48.871997+0000","last_active":"2024-09-18T00:31:48.871997+0000","last_peered":"2024-09-18T00:31:48.871997+0000","last_clean":"2024-09-18T00:31:48.871997+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:31:48.871997+0000","last_undegraded":"2024-09-18T00:31:48.871997+0000","last_fullsized":"2024-09-18T00:31:48.871997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:40:41.342320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052206099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.872116+0000","last_change":"2024-09-18T00:31:48.872116+0000","last_active":"2024-09-18T00:31:48.872116+0000","last_peered":"2024-09-18T00:31:48.872116+0000","last_clean":"2024-09-18T00:31:48.872116+0000","last_became_active":"2024-09-18T00:31:46.858825+0000","last_became_peered":"2024-09-18T00:31:46.858825+0000","last_unstale":"2024-09-18T00:31:48.872116+0000","last_undegraded":"2024-09-18T00:31:48.872116+0000","last_fullsized":"2024-09-18T00:31:48.872116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:03.653535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057934999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.985662+0000","last_change":"2024-09-18T00:31:48.985662+0000","last_active":"2024-09-18T00:31:48.985662+0000","last_peered":"2024-09-18T00:31:48.985662+0000","last_clean":"2024-09-18T00:31:48.985662+0000","last_became_active":"2024-09-18T00:31:46.856661+0000","last_became_peered":"2024-09-18T00:31:46.856661+0000","last_unstale":"2024-09-18T00:31:48.985662+0000","last_undegraded":"2024-09-18T00:31:48.985662+0000","last_fullsized":"2024-09-18T00:31:48.985662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:16:01.194442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027370699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.871732+0000","last_change":"2024-09-18T00:31:48.871732+0000","last_active":"2024-09-18T00:31:48.871732+0000","last_peered":"2024-09-18T00:31:48.871732+0000","last_clean":"2024-09-18T00:31:48.871732+0000","last_became_active":"2024-09-18T00:31:46.858556+0000","last_became_peered":"2024-09-18T00:31:46.858556+0000","last_unstale":"2024-09-18T00:31:48.871732+0000","last_undegraded":"2024-09-18T00:31:48.871732+0000","last_fullsized":"2024-09-18T00:31:48.871732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:12:53.342821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035443699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"28'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T00:31:51.909816+0000","last_change":"2024-09-18T00:31:48.866261+0000","last_active":"2024-09-18T00:31:51.909816+0000","last_peered":"2024-09-18T00:31:51.909816+0000","last_clean":"2024-09-18T00:31:51.909816+0000","last_became_active":"2024-09-18T00:31:46.858545+0000","last_became_peered":"2024-09-18T00:31:46.858545+0000","last_unstale":"2024-09-18T00:31:51.909816+0000","last_undegraded":"2024-09-18T00:31:51.909816+0000","last_fullsized":"2024-09-18T00:31:51.909816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:28:02.398886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047466899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-18T00:31:48.872343+0000","last_change":"2024-09-18T00:31:48.872343+0000","last_active":"2024-09-18T00:31:48.872343+0000","last_peered":"2024-09-18T00:31:48.872343+0000","last_clean":"2024-09-18T00:31:48.872343+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:31:48.872343+0000","last_undegraded":"2024-09-18T00:31:48.872343+0000","last_fullsized":"2024-09-18T00:31:48.872343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:19.751260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066573000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2426543,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":52,"num_read_kb":41,"num_write":30,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":23698,"data_compressed":35,"data_compressed_allocated":4096,"data_compressed_original":20480,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":331776,"data_stored":691790,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":101392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":101457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":101411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":101430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":258048,"data_stored":95189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":95189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":719873,"data_compressed":12668,"data_compressed_allocated":45056,"data_compressed_original":585728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":23584,"data_compressed":35,"data_compressed_allocated":4096,"data_compressed_original":20480,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":30,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:31:53.656 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T00:31:53.657 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:31:53.657 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:31:53.657 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.829336 2024-09-18T00:31:53.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.8293362318419747 2024-09-18T00:31:53.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:31:53.708 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:53.705+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:53.803 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:53.804 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:53.804 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:53.808 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:53.805+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:53.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:31:53.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:31:53.909 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:53.907+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2185 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.526934+0000", 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.396665737, 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012806598000000001, 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2185 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.526934+0000", 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.526934+0000", 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.526935+0000", 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5799999999999999e-07 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.526938+0000", 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7869999999999999e-06 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.526946+0000", 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6260000000000003e-06 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.526951+0000", 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5859999999999998e-06 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534350+0000", 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073988509999999997 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534418+0000", 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8021999999999993e-05 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.534762+0000", 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034454400000000001 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.537726+0000", 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029641469999999999 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539651+0000", 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001925179 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539700+0000", 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8142000000000001e-05 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539741+0000", 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1056000000000001e-05 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2236 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.560830+0000", 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.3627695630000001, 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012603774999999999, 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2236 2024-09-18T00:31:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.560830+0000", 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.560830+0000", 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.560831+0000", 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9100000000000003e-07 2024-09-18T00:31:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.560835+0000", 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3479999999999997e-06 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.560843+0000", 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8720000000000002e-06 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.560849+0000", 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3419999999999996e-06 2024-09-18T00:31:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.567934+0000", 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070845719999999999 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.567986+0000", 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1909000000000001e-05 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.568207+0000", 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022120700000000001 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.570847+0000", 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026401229999999999 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573356+0000", 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025087360000000001 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573395+0000", 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9255000000000003e-05 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573434+0000", 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2239 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.561086+0000", 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.3625139829999999, 2024-09-18T00:31:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012820814, 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2239 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561086+0000", 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561086+0000", 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561087+0000", 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5799999999999998e-07 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561091+0000", 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.33e-06 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561100+0000", 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0820000000000005e-06 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561107+0000", 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0169999999999999e-06 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.570186+0000", 2024-09-18T00:31:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.009079185 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.570237+0000", 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.570494+0000", 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025641299999999999 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.572042+0000", 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00154776 2024-09-18T00:31:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573807+0000", 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001765246 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573865+0000", 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8359000000000001e-05 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573907+0000", 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1338999999999998e-05 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2240 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.561172+0000", 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.3624276370000001, 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012874754, 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2240 2024-09-18T00:31:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561172+0000", 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561172+0000", 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561173+0000", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000003e-07 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561176+0000", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9450000000000002e-06 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561183+0000", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4050000000000003e-06 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.561187+0000", 2024-09-18T00:31:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1450000000000001e-06 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.571198+0000", 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010011041 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.571283+0000", 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4944000000000005e-05 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.571633+0000", 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035017400000000003 2024-09-18T00:31:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.572515+0000", 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00088214399999999996 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.573916+0000", 2024-09-18T00:31:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001400678 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.574013+0000", 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7127999999999996e-05 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.574047+0000", 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3637999999999999e-05 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2264 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.578886+0000", 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.3447135370000001, 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013127669, 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2264 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.950 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578886+0000", 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578886+0000", 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578887+0000", 2024-09-18T00:31:53.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.68e-07 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578890+0000", 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.23e-06 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578897+0000", 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9330000000000004e-06 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578900+0000", 2024-09-18T00:31:53.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0970000000000002e-06 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.585949+0000", 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070484659999999998 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.586004+0000", 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5275000000000002e-05 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.586209+0000", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000205047 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.588173+0000", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019645109999999999 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.591948+0000", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037743529999999998 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.591988+0000", 2024-09-18T00:31:53.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0788999999999999e-05 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592014+0000", 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5400000000000001e-05 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2265 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.578907+0000", 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.344692606, 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013212938, 2024-09-18T00:31:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2265 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578907+0000", 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578907+0000", 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578908+0000", 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.08e-07 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578910+0000", 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4590000000000001e-06 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578916+0000", 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9649999999999996e-06 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578920+0000", 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3290000000000004e-06 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.586454+0000", 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075338460000000003 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.586514+0000", 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9366e-05 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.586730+0000", 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000216479 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.588212+0000", 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014818030000000001 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592048+0000", 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038365920000000002 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592094+0000", 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5599999999999997e-05 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592120+0000", 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6091000000000001e-05 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2266 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.578935+0000", 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.344664885, 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013235429999999999, 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2266 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578935+0000", 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578935+0000", 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578935+0000", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7999999999999995e-07 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578938+0000", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9280000000000002e-06 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578946+0000", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3969999999999997e-06 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578952+0000", 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4219999999999997e-06 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.587135+0000", 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081823769999999994 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.587180+0000", 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5747000000000001e-05 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.587396+0000", 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000216111 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.588761+0000", 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013649910000000001 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592125+0000", 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033640369999999998 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592148+0000", 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2778000000000001e-05 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592170+0000", 2024-09-18T00:31:53.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2062e-05 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2267 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.578964+0000", 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.344635461, 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013290092, 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2267 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578964+0000", 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578964+0000", 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578965+0000", 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.41e-07 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578967+0000", 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578971+0000", 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1790000000000001e-06 2024-09-18T00:31:53.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578980+0000", 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.587651+0000", 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086712960000000002 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.587701+0000", 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9741999999999999e-05 2024-09-18T00:31:53.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.587916+0000", 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021573799999999999 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.589047+0000", 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011305709999999999 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592177+0000", 2024-09-18T00:31:53.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031295889999999999 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592217+0000", 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0272999999999999e-05 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592254+0000", 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.756e-05 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:2268 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.578989+0000", 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.344610321, 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013348282, 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2268 2024-09-18T00:31:53.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578989+0000", 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578989+0000", 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578990+0000", 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2399999999999999e-07 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578993+0000", 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9500000000000001e-06 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578996+0000", 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7890000000000001e-06 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.578999+0000", 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7980000000000001e-06 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.588233+0000", 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092337489999999994 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.588281+0000", 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7840000000000003e-05 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.588496+0000", 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021550000000000001 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.589350+0000", 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000853184 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592261+0000", 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029114879999999998 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592305+0000", 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3720000000000002e-05 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.592338+0000", 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.294e-05 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4452 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.976866+0000", 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.94673352399999999, 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01319996, 2024-09-18T00:31:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4452 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.976866+0000", 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.976866+0000", 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.976867+0000", 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8500000000000002e-07 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.976869+0000", 2024-09-18T00:31:53.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9889999999999999e-06 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.976877+0000", 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0479999999999999e-06 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.976880+0000", 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9830000000000001e-06 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986677+0000", 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097970850000000005 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986768+0000", 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1137999999999994e-05 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.987120+0000", 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035257300000000001 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989882+0000", 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027616559999999999 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989986+0000", 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103694 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.990032+0000", 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6108e-05 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.990066+0000", 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4400999999999998e-05 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4484 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.005222+0000", 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.91837797399999999, 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012810792, 2024-09-18T00:31:53.984 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4484 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005222+0000", 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005222+0000", 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005222+0000", 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.08e-07 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005225+0000", 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8459999999999999e-06 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005231+0000", 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.981e-06 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005236+0000", 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4909999999999999e-06 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.012336+0000", 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071008989999999999 2024-09-18T00:31:53.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.012400+0000", 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3283999999999999e-05 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.012613+0000", 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000213408 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014853+0000", 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022394490000000001 2024-09-18T00:31:53.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.017928+0000", 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030752380000000001 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.017985+0000", 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7336999999999997e-05 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018033+0000", 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7450999999999997e-05 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4485 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.005244+0000", 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.91835594499999995, 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012876545, 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4485 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005244+0000", 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005244+0000", 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005244+0000", 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2e-07 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005247+0000", 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6469999999999998e-06 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005258+0000", 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.084e-05 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005263+0000", 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.631e-06 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.012904+0000", 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076404630000000001 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.012953+0000", 2024-09-18T00:31:53.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8795000000000003e-05 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.013231+0000", 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027844099999999999 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014919+0000", 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016878539999999999 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018043+0000", 2024-09-18T00:31:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031242750000000001 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018091+0000", 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8235000000000002e-05 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018120+0000", 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8943999999999999e-05 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4486 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.005278+0000", 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.91832136200000003, 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012910110000000001, 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4486 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:53.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005278+0000", 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005278+0000", 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005279+0000", 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.51e-07 2024-09-18T00:31:53.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005282+0000", 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.942e-06 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005293+0000", 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1369000000000001e-05 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005298+0000", 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8210000000000001e-06 2024-09-18T00:31:53.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.013728+0000", 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084303659999999999 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.013811+0000", 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2381999999999998e-05 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014021+0000", 2024-09-18T00:31:53.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000210559 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.016682+0000", 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026609369999999999 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018126+0000", 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014434199999999999 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018155+0000", 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9731999999999999e-05 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018189+0000", 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3130999999999998e-05 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4487 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.005306+0000", 2024-09-18T00:31:54.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.91829362800000003, 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01402581, 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4487 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005306+0000", 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005306+0000", 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005307+0000", 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2800000000000002e-07 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005310+0000", 2024-09-18T00:31:54.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1300000000000001e-06 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005317+0000", 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8469999999999998e-06 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005321+0000", 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014286+0000", 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089648920000000003 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014337+0000", 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0745999999999998e-05 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014524+0000", 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000187095 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018196+0000", 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036718240000000002 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019263+0000", 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010670530000000001 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019294+0000", 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1053999999999998e-05 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019332+0000", 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8028999999999998e-05 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4488 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.005335+0000", 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.918264529, 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014147282000000001, 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4488 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005335+0000", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005335+0000", 2024-09-18T00:31:54.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005336+0000", 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005338+0000", 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.802e-06 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005345+0000", 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5989999999999998e-06 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005350+0000", 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.014959+0000", 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0096089639999999994 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.015013+0000", 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3771999999999999e-05 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.015239+0000", 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022630299999999999 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018372+0000", 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031327070000000002 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019390+0000", 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010186430000000001 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019445+0000", 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4369000000000001e-05 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019483+0000", 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7857e-05 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4489 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.005357+0000", 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.91824308700000001, 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014274650999999999, 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4489 2024-09-18T00:31:54.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005357+0000", 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005357+0000", 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005357+0000", 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2399999999999999e-07 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005360+0000", 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.65e-06 2024-09-18T00:31:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005366+0000", 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.005370+0000", 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6280000000000004e-06 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.015665+0000", 2024-09-18T00:31:54.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010294461 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.015751+0000", 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6118000000000005e-05 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.016123+0000", 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000371994 2024-09-18T00:31:54.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.018428+0000", 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023050079999999999 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019547+0000", 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001118619 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019596+0000", 2024-09-18T00:31:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9298999999999997e-05 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.019631+0000", 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5395000000000002e-05 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4522 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.028802+0000", 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89479800300000001, 2024-09-18T00:31:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013305637, 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4522 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028802+0000", 2024-09-18T00:31:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028802+0000", 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028802+0000", 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6100000000000001e-07 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028805+0000", 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028812+0000", 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4649999999999999e-06 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028816+0000", 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7029999999999997e-06 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.037931+0000", 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091148110000000004 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.038005+0000", 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3799000000000003e-05 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.038321+0000", 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031638400000000001 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.040829+0000", 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025078399999999999 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.041996+0000", 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001167335 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042062+0000", 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5841999999999997e-05 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042107+0000", 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5155999999999999e-05 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4523 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.028850+0000", 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89474926200000005, 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01335045, 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4523 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028850+0000", 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028850+0000", 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028851+0000", 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028854+0000", 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3110000000000001e-06 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028862+0000", 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.588e-06 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028868+0000", 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.038968+0000", 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010100812000000001 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.039145+0000", 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017679800000000001 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.039518+0000", 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037308799999999999 2024-09-18T00:31:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.040970+0000", 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001451674 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042117+0000", 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011468190000000001 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042160+0000", 2024-09-18T00:31:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3751000000000002e-05 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042201+0000", 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0488000000000003e-05 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4524 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.028891+0000", 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89470849500000005, 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013408438, 2024-09-18T00:31:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4524 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028891+0000", 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028891+0000", 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028892+0000", 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.06e-07 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028895+0000", 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8339999999999999e-06 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028903+0000", 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9100000000000005e-06 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028908+0000", 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1730000000000003e-06 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.039995+0000", 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011087387000000001 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.040048+0000", 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2590000000000003e-05 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.040294+0000", 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024645100000000002 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.041960+0000", 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001665311 2024-09-18T00:31:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042209+0000", 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024957199999999999 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042259+0000", 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0188999999999997e-05 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042300+0000", 2024-09-18T00:31:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0414999999999998e-05 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:4525 3.1e 3:7ceed6ac:::rbd_object_map.1197f1330e07:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.028951+0000", 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89464829400000001, 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015463312, 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4525 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028951+0000", 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028951+0000", 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028952+0000", 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4999999999999998e-07 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028955+0000", 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.858e-06 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028961+0000", 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7910000000000001e-06 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.028964+0000", 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9330000000000003e-06 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.041014+0000", 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012049828 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.041073+0000", 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9131e-05 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.041374+0000", 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030008600000000003 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.042338+0000", 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00096413300000000005 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.044312+0000", 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019743529999999999 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.044374+0000", 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2306999999999998e-05 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.044415+0000", 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0441999999999997e-05 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:54.042 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:54.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:31:54.044 INFO:teuthology.orchestra.run.smithi081.stdout:flattening image image_client.0-clone2 2024-09-18T00:31:54.044 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:54.042+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:54.145 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:54.143+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:54.150 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:31:54.150 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:54.159 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:31:54.169 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-18T00:31:54.185 INFO:teuthology.orchestra.run.smithi081.stdout:320 write 0x96e2229 thru 0x96e8820 (0x65f8 bytes) 2024-09-18T00:31:54.197 INFO:teuthology.orchestra.run.smithi081.stdout:321 read 0x64bad1c thru 0x64c0bd7 (0x5ebc bytes) 2024-09-18T00:31:54.197 INFO:teuthology.orchestra.run.smithi081.stdout:322 read 0x2cdc27f thru 0x2cea2a9 (0xe02b bytes) 2024-09-18T00:31:54.198 INFO:teuthology.orchestra.run.smithi081.stdout:324 read 0xfb849c thru 0xfc65ac (0xe111 bytes) 2024-09-18T00:31:54.203 INFO:teuthology.orchestra.run.smithi081.stdout:326 write 0x9cffc12 thru 0x9d03b6b (0x3f5a bytes) 2024-09-18T00:31:54.209 INFO:teuthology.orchestra.run.smithi081.stdout:329 write 0x3409640 thru 0x3414b28 (0xb4e9 bytes) 2024-09-18T00:31:54.223 INFO:teuthology.orchestra.run.smithi081.stdout:330 read 0x882736c thru 0x882f62f (0x82c4 bytes) 2024-09-18T00:31:54.234 INFO:teuthology.orchestra.run.smithi081.stdout:331 write 0xe500e88 thru 0xe504a88 (0x3c01 bytes) 2024-09-18T00:31:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:332 read 0x15e324d thru 0x15f1af9 (0xe8ad bytes) 2024-09-18T00:31:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:334 write 0x400cfc thru 0x40a138 (0x943d bytes) 2024-09-18T00:31:54.246 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:54.243+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:54.305 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:54.305 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:54.305 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:31:54.305 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:31:54.305 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:54.318 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:31:54.360 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:54.357+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:54.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:31:54.447 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:54.445+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:54.464 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:54.464 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:31:54.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:31:54.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:31:54.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7122 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 190464~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.184106408, 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035116663999999999, 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7122 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:54.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2899999999999999e-07 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277625+0000", 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3999999999999999e-06 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277633+0000", 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4130000000000006e-06 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277637+0000", 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.172e-06 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312537+0000", 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034899342999999999 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312627+0000", 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0648000000000004e-05 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312740+0000", 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000112359 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7123 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 221184~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18408771800000001, 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035332513000000003, 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7123 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4400000000000001e-07 2024-09-18T00:31:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277643+0000", 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.398e-06 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277652+0000", 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3899999999999993e-06 2024-09-18T00:31:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277657+0000", 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7400000000000004e-06 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312778+0000", 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035121364000000002 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312861+0000", 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3448000000000005e-05 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312974+0000", 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000112829 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7124 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 251904~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.184068487, 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035562763999999997, 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7124 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277663+0000", 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4169999999999999e-06 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277672+0000", 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8230000000000001e-06 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277676+0000", 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1189999999999999e-06 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313027+0000", 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035351120999999999 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313116+0000", 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9198999999999998e-05 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313224+0000", 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107753 2024-09-18T00:31:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7353 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 32768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18131724099999999, 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034846251000000002, 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7353 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280414+0000", 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.906e-06 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280423+0000", 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.799e-06 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280427+0000", 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9430000000000002e-06 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315067+0000", 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034639688000000002 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315153+0000", 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5937000000000001e-05 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315258+0000", 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105685 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7354 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.181297502, 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035063057000000002, 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7354 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280438+0000", 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8980000000000001e-06 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280447+0000", 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7620000000000001e-06 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280455+0000", 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1000000000000004e-06 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315289+0000", 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034834175000000002 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315374+0000", 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4561999999999994e-05 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315495+0000", 2024-09-18T00:31:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012123799999999999 2024-09-18T00:31:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7355 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 94208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18126951099999999, 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035184698, 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7355 2024-09-18T00:31:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4299999999999999e-07 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280462+0000", 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4890000000000001e-06 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280470+0000", 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7469999999999994e-06 2024-09-18T00:31:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280474+0000", 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9689999999999996e-06 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315536+0000", 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035061267 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315582+0000", 2024-09-18T00:31:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6758999999999997e-05 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315645+0000", 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2124000000000004e-05 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7356 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18125037899999999, 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035315234000000001, 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7356 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.15e-07 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280481+0000", 2024-09-18T00:31:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3540000000000001e-06 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280489+0000", 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.687e-06 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280494+0000", 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1219999999999997e-06 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315664+0000", 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035170068999999998 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315703+0000", 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9774000000000002e-05 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315794+0000", 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0913000000000002e-05 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7357 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 155648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.181231424, 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035509805999999998, 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7357 2024-09-18T00:31:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.34e-07 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280500+0000", 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.376e-06 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280509+0000", 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9139999999999997e-06 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280513+0000", 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0049999999999998e-06 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315839+0000", 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035326125 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315906+0000", 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6816000000000005e-05 2024-09-18T00:31:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316008+0000", 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000102236 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7358 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18121253100000001, 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035736118999999997, 2024-09-18T00:31:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7358 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:31:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280519+0000", 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4020000000000001e-06 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280528+0000", 2024-09-18T00:31:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9099999999999994e-06 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280532+0000", 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1409999999999998e-06 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316065+0000", 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035533125999999998 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316149+0000", 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4396999999999998e-05 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316253+0000", 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010381499999999999 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7359 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.181193412, 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035936628999999998, 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7359 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1800000000000002e-07 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280538+0000", 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.353e-06 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280546+0000", 2024-09-18T00:31:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.687e-06 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280550+0000", 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9299999999999996e-06 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316290+0000", 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035740174999999999 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316370+0000", 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9776000000000003e-05 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316473+0000", 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010239 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7360 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18117486099999999, 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036148172999999999, 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7360 2024-09-18T00:31:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280556+0000", 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.269e-06 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280565+0000", 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7770000000000008e-06 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280573+0000", 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9889999999999992e-06 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316508+0000", 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035935024000000003 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316596+0000", 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8337999999999993e-05 2024-09-18T00:31:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316703+0000", 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000106446 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7397 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 0~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.180969776, 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036164448000000002, 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7397 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280762+0000", 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5820000000000001e-06 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280770+0000", 2024-09-18T00:31:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7250000000000003e-06 2024-09-18T00:31:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280774+0000", 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1219999999999997e-06 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316751+0000", 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035976418000000003 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316824+0000", 2024-09-18T00:31:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3310000000000001e-05 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316924+0000", 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9951000000000006e-05 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7398 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 30720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.180950626, 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036418438999999997, 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7398 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280780+0000", 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.265e-06 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280789+0000", 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6340000000000007e-06 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280793+0000", 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0600000000000001e-06 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317017+0000", 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036223878000000001 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317105+0000", 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8398000000000003e-05 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317197+0000", 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1872000000000004e-05 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7399 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 61440~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18093203899999999, 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036546236000000003, 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7399 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280798+0000", 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1899999999999998e-07 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280799+0000", 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.406e-06 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280808+0000", 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.755e-06 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280813+0000", 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.502e-06 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317227+0000", 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036413244999999997 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317285+0000", 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8585999999999998e-05 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317344+0000", 2024-09-18T00:31:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8423e-05 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7400 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18091172699999999, 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036756206999999999, 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7400 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280820+0000", 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8479999999999999e-06 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280829+0000", 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8920000000000006e-06 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280833+0000", 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0579999999999999e-06 2024-09-18T00:31:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317395+0000", 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036562134000000003 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317468+0000", 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3045000000000003e-05 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317574+0000", 2024-09-18T00:31:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0001059 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7401 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.180891938, 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036942361999999999, 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7401 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280838+0000", 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.34e-07 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280840+0000", 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0200000000000001e-06 2024-09-18T00:31:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280848+0000", 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2740000000000007e-06 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280852+0000", 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0820000000000001e-06 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317630+0000", 2024-09-18T00:31:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036777720999999999 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317706+0000", 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6415000000000006e-05 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317780+0000", 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3516000000000006e-05 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7402 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 153600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18087281499999999, 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037129595000000001, 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7402 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4900000000000001e-07 2024-09-18T00:31:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280859+0000", 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9069999999999999e-06 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280868+0000", 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8769999999999999e-06 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280872+0000", 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0130000000000004e-06 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317825+0000", 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036953565000000001 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317921+0000", 2024-09-18T00:31:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5680000000000005e-05 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317986+0000", 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5203999999999994e-05 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7403 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 184320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.180849281, 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037274802000000003, 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7403 2024-09-18T00:31:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8299999999999998e-07 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280882+0000", 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.443e-06 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280887+0000", 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0459999999999996e-06 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280891+0000", 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4429999999999996e-06 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318016+0000", 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037124181999999999 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318075+0000", 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9197000000000003e-05 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318155+0000", 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0208000000000002e-05 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7404 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.180832731, 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037392851999999997, 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7404 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280898+0000", 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4890000000000001e-06 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280903+0000", 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8779999999999997e-06 2024-09-18T00:31:54.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280908+0000", 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.605e-06 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318192+0000", 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037284099000000001 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318237+0000", 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5429999999999997e-05 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318290+0000", 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2049000000000003e-05 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7405 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.18081466199999999, 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037501131, 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7405 2024-09-18T00:31:54.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7599999999999998e-07 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280920+0000", 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9099999999999996e-06 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280926+0000", 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2049999999999999e-06 2024-09-18T00:31:54.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280931+0000", 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000003e-06 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318315+0000", 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037383779999999998 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:54.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318372+0000", 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6671e-05 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318416+0000", 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4178999999999998e-05 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:54.569 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:54.570 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:54.571 INFO:teuthology.orchestra.run.smithi081.stdout:335 trunc from 0xe504a89 to 0x2ec0bac 2024-09-18T00:31:54.571 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:54.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:31:54.573 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:54.573 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:54.574 INFO:teuthology.orchestra.run.smithi081.stdout:336 trunc from 0x2ec0bac to 0xe19f685 2024-09-18T00:31:54.574 INFO:teuthology.orchestra.run.smithi081.stdout:337 read 0xa3875a3 thru 0xa389fc4 (0x2a22 bytes) 2024-09-18T00:31:54.574 INFO:teuthology.orchestra.run.smithi081.stdout:338 write 0x46cf4c8 thru 0x46d519d (0x5cd6 bytes) 2024-09-18T00:31:54.575 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:54.569+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:54.579 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:54.579 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:54.580 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:54.580 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:54.580 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:54.580 INFO:teuthology.orchestra.run.smithi081.stdout:347 writesame 0x1fc67bd thru 0x1fd643e data_size 0x1(0xfc82 bytes) 2024-09-18T00:31:54.600 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:54.620 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:54.621 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:54.627 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:54.627 INFO:teuthology.orchestra.run.smithi081.stdout:349 read 0x1c47287 thru 0x1c4a84e (0x35c8 bytes) 2024-09-18T00:31:54.633 INFO:teuthology.orchestra.run.smithi081.stdout:350 write 0xeb821bf thru 0xeb8ded4 (0xbd16 bytes) 2024-09-18T00:31:54.638 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:54.639 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:54.649 INFO:teuthology.orchestra.run.smithi081.stdout:351 write 0x992fd81 thru 0x993d7f3 (0xda73 bytes) 2024-09-18T00:31:54.665 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:54.665 INFO:teuthology.orchestra.run.smithi081.stdout:356 punch from 0x84f1b70 to 0x84f4387, (0x2817 bytes) 2024-09-18T00:31:54.665 INFO:teuthology.orchestra.run.smithi081.stdout:357 read 0xe14d9e2 thru 0xe15076d (0x2d8c bytes) 2024-09-18T00:31:54.671 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:54.669+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:54.681 INFO:teuthology.orchestra.run.smithi081.stdout:358 trunc from 0xeb8ded5 to 0xfd1b30 2024-09-18T00:31:54.697 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:54.697 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:54.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:31:54.749 INFO:teuthology.orchestra.run.smithi081.stdout:360 trunc from 0xfd1b30 to 0x4151ee2 2024-09-18T00:31:54.769 INFO:teuthology.orchestra.run.smithi081.stdout:361 writesame 0x9c3c3ca thru 0x9c4b1ee data_size 0x5(0xee25 bytes) 2024-09-18T00:31:54.781 INFO:teuthology.orchestra.run.smithi081.stdout:362 writesame 0xc09c595 thru 0xc09dff8 data_size 0x6(0x1a64 bytes) 2024-09-18T00:31:54.781 INFO:teuthology.orchestra.run.smithi081.stdout:364 read 0xafefc3d thru 0xaffea15 (0xedd9 bytes) 2024-09-18T00:31:54.781 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:54.789 INFO:teuthology.orchestra.run.smithi081.stdout:367 trunc from 0xc09dff9 to 0x4c9ce92 2024-09-18T00:31:54.793 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:54.791+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:54.801 INFO:teuthology.orchestra.run.smithi081.stdout:369 trunc from 0x4c9ce92 to 0xd1de76 2024-09-18T00:31:54.849 INFO:teuthology.orchestra.run.smithi081.stdout:371 write 0x2e61939 thru 0x2e68c63 (0x732b bytes) 2024-09-18T00:31:54.868 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:54.868 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:54.873 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:54.871+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:54.876 INFO:teuthology.orchestra.run.smithi081.stdout:372 writesame 0xac3f20b thru 0xac4dc9a data_size 0x18(0xea90 bytes) 2024-09-18T00:31:54.876 INFO:teuthology.orchestra.run.smithi081.stdout:373 punch from 0x1d4cc6b to 0x1d541cf, (0x7564 bytes) 2024-09-18T00:31:54.876 INFO:teuthology.orchestra.run.smithi081.stdout:374 read 0x26232fc thru 0x2628d0b (0x5a10 bytes) 2024-09-18T00:31:54.877 INFO:teuthology.orchestra.run.smithi081.stdout:375 punch from 0x7e39b8f to 0x7e3cf81, (0x33f2 bytes) 2024-09-18T00:31:54.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:31:54.879 INFO:teuthology.orchestra.run.smithi081.stdout:376 trunc from 0xac4dc9b to 0x89350ac 2024-09-18T00:31:54.883 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.7 primary-affinity to 0.829336 (8543512) 2024-09-18T00:31:54.883 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:31:54.974 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:54.972+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:55.021 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.021 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:31:55.075 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:55.073+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:55.133 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.133 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:31:55.176 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:55.175+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:55.277 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:55.274+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:55.285 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.285 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:31:55.377 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:55.376+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:55.440 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.440 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:31:55.478 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:55.476+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:55.552 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.552 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:31:55.603 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:55.601+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:55.664 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.664 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:31:55.713 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:55.712+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:55.780 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:55.779+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:55.814 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.814 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:31:55.881 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:55.880+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:55.905 INFO:teuthology.orchestra.run.smithi081.stdout:377 punch from 0x3bf2832 to 0x3bf8f0a, (0x66d8 bytes) 2024-09-18T00:31:55.905 INFO:teuthology.orchestra.run.smithi081.stdout:378 punch from 0x595ab25 to 0x59636ad, (0x8b88 bytes) 2024-09-18T00:31:55.905 INFO:teuthology.orchestra.run.smithi081.stdout:379 clone 4 order 23 su 262144 sc 15 2024-09-18T00:31:55.940 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:55.940 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:55.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:31:55.982 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:55.981+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:56.083 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:56.081+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:56.094 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:56.094 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:56.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:31:56.184 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:56.182+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:56.204 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:56.204 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:56.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:31:56.284 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:56.283+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:56.316 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:56.316 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:56.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:31:56.386 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:56.384+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:56.468 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:56.468 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:56.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:31:56.486 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:56.484+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:56.579 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:56.579 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:56.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:31:56.588 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:56.586+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:56.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:31:56.688 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:56.686+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:56.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:31:56.789 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:56.787+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:56.798 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:56.819 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone3 from 0x89350ac (overlap 0xd1de76) to 0x0 2024-09-18T00:31:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:56.838 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:56.875 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:56.876 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:56.876 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:56.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:31:56.890 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:56.888+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:56.894 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:56.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:31:56.912 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:56.913 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:56.930 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-18T00:31:56.931 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:56.932 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:56.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:56.990 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:56.989+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:57.022 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4281.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.876028525999999, 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00093050499999999998, 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144153+0000", 2024-09-18T00:31:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144154+0000", 2024-09-18T00:31:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5600000000000005e-07 2024-09-18T00:31:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144165+0000", 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1593000000000001e-05 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144174+0000", 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5809999999999997e-06 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144183+0000", 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4790000000000002e-06 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144231+0000", 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7809000000000003e-05 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.144258+0000", 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6301000000000001e-05 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.145041+0000", 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00078354599999999998 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:37.145084+0000", 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2540000000000003e-05 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:995 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'50, mlcod=29'48)", 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.318726+0000", 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7014556890000003, 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024166359999999998, 2024-09-18T00:31:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318726+0000", 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318726+0000", 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318727+0000", 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1999999999999998e-07 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318733+0000", 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318746+0000", 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3008e-05 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318753+0000", 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2910000000000002e-06 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318807+0000", 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3690999999999998e-05 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.318827+0000", 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0258000000000002e-05 2024-09-18T00:31:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.321104+0000", 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022767320000000001 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.321143+0000", 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8597000000000003e-05 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:1002 3.0 e29/23 3:049b8f32:::rbd_data.1197f1330e07.0000000000000237:head v 29'6, mlcod=28'4)", 2024-09-18T00:31:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.327422+0000", 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6927595130000004, 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022624210000000001, 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327422+0000", 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327422+0000", 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327423+0000", 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0100000000000003e-07 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327443+0000", 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0288e-05 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327456+0000", 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2734e-05 2024-09-18T00:31:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327464+0000", 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6389999999999992e-06 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327524+0000", 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0294000000000002e-05 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.327547+0000", 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3455000000000002e-05 2024-09-18T00:31:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329639+0000", 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020917539999999999 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.329685+0000", 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5355999999999997e-05 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2051 3.4 e29/23 3:27d19dec:::rbd_data.1197f1330e07.000000000000003c:head v 29'10, mlcod=28'8)", 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.377755+0000", 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6424268680000003, 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001108585, 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377755+0000", 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377755+0000", 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377756+0000", 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999999999999999e-06 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377842+0000", 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5609e-05 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377856+0000", 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4099e-05 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377863+0000", 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5100000000000001e-06 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377921+0000", 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7853000000000003e-05 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.377943+0000", 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2059e-05 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.378818+0000", 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087449999999999995 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.378863+0000", 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5754999999999998e-05 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4850327290000003, 2024-09-18T00:31:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:31:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:31:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2224 3.0 e29/23 3:01033e15:::rbd_data.1197f1330e07.00000000000000a5:head v 29'8, mlcod=29'6)", 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.557647+0000", 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4625346170000002, 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001049454, 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557647+0000", 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557647+0000", 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557648+0000", 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.26e-06 2024-09-18T00:31:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557668+0000", 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0163999999999999e-05 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557686+0000", 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7893999999999998e-05 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557695+0000", 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9430000000000006e-06 2024-09-18T00:31:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557769+0000", 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3671000000000007e-05 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.557792+0000", 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3105e-05 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.558659+0000", 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00086652400000000003 2024-09-18T00:31:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.558697+0000", 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7892999999999998e-05 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2388 3.9 e29/23 3:948dfdcb:::rbd_data.1197f1330e07.00000000000001b3:head v 29'51, mlcod=29'49)", 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.646680+0000", 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3735012519999996, 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016987879999999999, 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646680+0000", 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646680+0000", 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646682+0000", 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-06 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646692+0000", 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0576e-05 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646708+0000", 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5164000000000001e-05 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646715+0000", 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7770000000000002e-06 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646781+0000", 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.601e-05 2024-09-18T00:31:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.646807+0000", 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6069000000000001e-05 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.648341+0000", 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001533981 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.648379+0000", 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7857e-05 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2402 3.4 e29/23 3:268cbbc0:::rbd_data.1197f1330e07.000000000000009a:head v 29'13, mlcod=29'11)", 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.677504+0000", 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3426773499999998, 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014091030000000001, 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677504+0000", 2024-09-18T00:31:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677504+0000", 2024-09-18T00:31:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677506+0000", 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.632e-06 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677517+0000", 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1401e-05 2024-09-18T00:31:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677538+0000", 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0642999999999999e-05 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677547+0000", 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2220000000000008e-06 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677606+0000", 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8334000000000001e-05 2024-09-18T00:31:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.677626+0000", 2024-09-18T00:31:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0866e-05 2024-09-18T00:31:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678866+0000", 2024-09-18T00:31:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012395419999999999 2024-09-18T00:31:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.678913+0000", 2024-09-18T00:31:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7463000000000003e-05 2024-09-18T00:31:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2413 3.0 e29/23 3:01033e15:::rbd_data.1197f1330e07.00000000000000a5:head v 29'11, mlcod=29'9)", 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3410639800000004, 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002684512, 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679118+0000", 2024-09-18T00:31:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3399999999999998e-07 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679126+0000", 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4039999999999998e-06 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679139+0000", 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2763e-05 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679146+0000", 2024-09-18T00:31:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9970000000000001e-06 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679209+0000", 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3175000000000004e-05 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679230+0000", 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1319e-05 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681761+0000", 2024-09-18T00:31:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025310900000000002 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.681802+0000", 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1029999999999998e-05 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3406462729999999, 2024-09-18T00:31:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2424 3.0 e29/23 3:0295e385:::rbd_data.1197f1330e07.0000000000000158:head v 29'13, mlcod=29'10)", 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.684869+0000", 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3353124909999998, 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024667030000000002, 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684869+0000", 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684869+0000", 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684870+0000", 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.06e-07 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684880+0000", 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0000000000000001e-05 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684890+0000", 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7650000000000005e-06 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684896+0000", 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8939999999999998e-06 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684935+0000", 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9613999999999997e-05 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684949+0000", 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.414e-05 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.687298+0000", 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023490429999999999 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.687336+0000", 2024-09-18T00:31:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7540999999999999e-05 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2454 3.9 e29/23 3:948dfdcb:::rbd_data.1197f1330e07.00000000000001b3:head v 29'52, mlcod=29'50)", 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.696670+0000", 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.323511538, 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002079254, 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696670+0000", 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696670+0000", 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696671+0000", 2024-09-18T00:31:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7000000000000003e-07 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696679+0000", 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9589999999999995e-06 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696690+0000", 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.059e-05 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696697+0000", 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0940000000000002e-06 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696755+0000", 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8425999999999999e-05 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.696776+0000", 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0712000000000001e-05 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.698699+0000", 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019231459999999999 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.698749+0000", 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0457000000000002e-05 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:31:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3153294439999996, 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:31:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:31:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2482 3.0 e29/23 3:049b8f32:::rbd_data.1197f1330e07.0000000000000237:head v 29'14, mlcod=29'12)", 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.707745+0000", 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3124367350000004, 2024-09-18T00:31:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016652259999999999, 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707745+0000", 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707745+0000", 2024-09-18T00:31:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707746+0000", 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999995e-07 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707752+0000", 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6900000000000003e-06 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707765+0000", 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.237e-05 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707771+0000", 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3539999999999996e-06 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707820+0000", 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9166999999999999e-05 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.707841+0000", 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0760000000000001e-05 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709370+0000", 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001529341 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709410+0000", 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9808999999999998e-05 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2589 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'16, mlcod=29'14)", 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.755966+0000", 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2642159829999997, 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022669000000000001, 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755966+0000", 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755966+0000", 2024-09-18T00:31:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755967+0000", 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6199999999999996e-07 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755976+0000", 2024-09-18T00:31:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3889999999999994e-06 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755989+0000", 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3441000000000001e-05 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.755997+0000", 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4220000000000003e-06 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.756064+0000", 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7669000000000006e-05 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.756087+0000", 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2609e-05 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.758181+0000", 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020937830000000001 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.758233+0000", 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1724999999999997e-05 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:4461 3.0 e30/23 3:0295e385:::rbd_data.1197f1330e07.0000000000000158:head v 30'16, mlcod=29'14)", 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.0335678049999997, 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031733740000000001, 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986615+0000", 2024-09-18T00:31:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.359e-06 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986626+0000", 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1136e-05 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986643+0000", 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986653+0000", 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9979999999999998e-06 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986718+0000", 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4527000000000001e-05 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986739+0000", 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0953000000000001e-05 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989736+0000", 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029969340000000001 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989787+0000", 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1598999999999998e-05 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:5444 3.9 e31/23 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:head v 31'55, mlcod=29'53)", 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:54.038732+0000", 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.9814497129999999, 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021649379999999999, 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.038732+0000", 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.038732+0000", 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.038732+0000", 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.85e-07 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039096+0000", 2024-09-18T00:31:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000364223 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039106+0000", 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.662e-06 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039113+0000", 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039174+0000", 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0637000000000002e-05 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039194+0000", 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9848999999999999e-05 2024-09-18T00:31:57.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.040851+0000", 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016569340000000001 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.040897+0000", 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6109999999999997e-05 2024-09-18T00:31:57.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:5445 3.9 e31/23 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:head v 31'57, mlcod=29'53)", 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:54.039712+0000", 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.980469555, 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001547362, 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039712+0000", 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039712+0000", 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039713+0000", 2024-09-18T00:31:57.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9100000000000004e-07 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039719+0000", 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039727+0000", 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2029999999999992e-06 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039733+0000", 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5599999999999999e-06 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039779+0000", 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5899999999999998e-05 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.039799+0000", 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9408000000000001e-05 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.041221+0000", 2024-09-18T00:31:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014219230000000001 2024-09-18T00:31:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.041259+0000", 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8924000000000002e-05 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:8266 3.0 e31/23 3:01128854:::rbd_data.1197efd981f1.00000000000001c8:head v 31'18, mlcod=30'16)", 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:54.526521+0000", 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.493660497, 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001729675, 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526521+0000", 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526521+0000", 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526522+0000", 2024-09-18T00:31:57.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8199999999999999e-07 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526529+0000", 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6370000000000002e-06 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526542+0000", 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3786e-05 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526551+0000", 2024-09-18T00:31:57.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4030000000000007e-06 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526610+0000", 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9083999999999999e-05 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.526634+0000", 2024-09-18T00:31:57.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4195000000000001e-05 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.528210+0000", 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015757130000000001 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.528251+0000", 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1075000000000002e-05 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:9280 3.9 e34/23 3:97591ed3:::rbd_data.1197efd981f1.000000000000000a:head v 34'78, mlcod=34'74)", 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:56.852672+0000", 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.167509826, 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010479910000000001, 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852672+0000", 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852672+0000", 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852673+0000", 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4729999999999999e-06 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852684+0000", 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0963e-05 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852704+0000", 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9871e-05 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852713+0000", 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0960000000000007e-06 2024-09-18T00:31:57.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852771+0000", 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8232000000000001e-05 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.852795+0000", 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3078000000000002e-05 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.853679+0000", 2024-09-18T00:31:57.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00088397499999999995 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:56.853720+0000", 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1303000000000001e-05 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.125 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:57.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:31:57.127 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:57.125+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:57.152 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:57.152 INFO:teuthology.orchestra.run.smithi081.stdout:381 trunc from 0x89350ac to 0x881527d 2024-09-18T00:31:57.172 INFO:teuthology.orchestra.run.smithi081.stdout:382 read 0x5e2c8bb thru 0x5e34c2e (0x8374 bytes) 2024-09-18T00:31:57.172 INFO:teuthology.orchestra.run.smithi081.stdout:383 write 0x354175f thru 0x3547eb6 (0x6758 bytes) 2024-09-18T00:31:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:384 writesame 0x18f18a1 thru 0x18f264c data_size 0x2(0xdac bytes) 2024-09-18T00:31:57.189 INFO:teuthology.orchestra.run.smithi081.stdout:386 read 0x426f8dc thru 0x427153d (0x1c62 bytes) 2024-09-18T00:31:57.190 INFO:teuthology.orchestra.run.smithi081.stdout:387 write 0x844e439 thru 0x8458fe7 (0xabaf bytes) 2024-09-18T00:31:57.191 INFO:teuthology.orchestra.run.smithi081.stdout:389 read 0x3241bf9 thru 0x32446ba (0x2ac2 bytes) 2024-09-18T00:31:57.198 INFO:teuthology.orchestra.run.smithi081.stdout:390 write 0x9b6d0a8 thru 0x9b715b4 (0x450d bytes) 2024-09-18T00:31:57.202 INFO:teuthology.orchestra.run.smithi081.stdout:392 trunc from 0x9b715b5 to 0x7abe626 2024-09-18T00:31:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:393 trunc from 0x7abe626 to 0xde16242 2024-09-18T00:31:57.227 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:57.226+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:57.231 INFO:teuthology.orchestra.run.smithi081.stdout:394 write 0xc27847e thru 0xc281787 (0x930a bytes) 2024-09-18T00:31:57.241 INFO:teuthology.orchestra.run.smithi081.stdout:396 writesame 0x58abb66 thru 0x58b1c8f data_size 0x1(0x612a bytes) 2024-09-18T00:31:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:397 write 0x202dc0f thru 0x202e2d1 (0x6c3 bytes) 2024-09-18T00:31:57.269 INFO:teuthology.orchestra.run.smithi081.stdout:398 read 0x4bbdcc1 thru 0x4bc2a6f (0x4daf bytes) 2024-09-18T00:31:57.279 INFO:teuthology.orchestra.run.smithi081.stdout:399 trunc from 0xde16242 to 0x62189e6 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:11620 3.5 e34/23 3:a400d56d:::rbd_data.11977ed65175.0000000000000006:head v 34'32, mlcod=34'29)", 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:57.323317+0000", 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00052465900000000002, 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00055199700000000003, 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323317+0000", 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323317+0000", 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323318+0000", 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0599999999999999e-07 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323325+0000", 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5329999999999997e-06 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323339+0000", 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4046000000000001e-05 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323347+0000", 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3880000000000002e-06 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323402+0000", 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5105999999999997e-05 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:57.323420+0000", 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8275999999999999e-05 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.329 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:31:57.329 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-18T00:31:57.329 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:57.330 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:57.328+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:57.333 INFO:teuthology.orchestra.run.smithi081.stdout:401 read 0x5b41446 thru 0x5b4ef37 (0xdaf2 bytes) 2024-09-18T00:31:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:405 punch from 0x2cbd3d7 to 0x2ccc989, (0xf5b2 bytes) 2024-09-18T00:31:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:57.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:31:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:408 write 0xcec418d thru 0xcece716 (0xa58a bytes) 2024-09-18T00:31:57.350 INFO:teuthology.orchestra.run.smithi081.stdout:409 write 0x27c0c01 thru 0x27c0f05 (0x305 bytes) 2024-09-18T00:31:57.351 INFO:teuthology.orchestra.run.smithi081.stdout:410 write 0x8597e35 thru 0x85a29ce (0xab9a bytes) 2024-09-18T00:31:57.354 INFO:teuthology.orchestra.run.smithi081.stdout:411 write 0x81c7450 thru 0x81c9b28 (0x26d9 bytes) 2024-09-18T00:31:57.368 INFO:teuthology.orchestra.run.smithi081.stdout:414 trunc from 0xcece717 to 0x2767d7d 2024-09-18T00:31:57.384 INFO:teuthology.orchestra.run.smithi081.stdout:415 read 0x1d4489c thru 0x1d4b273 (0x69d8 bytes) 2024-09-18T00:31:57.393 INFO:teuthology.orchestra.run.smithi081.stdout:418 writesame 0x50a8a21 thru 0x50adff5 data_size 0x7(0x55d5 bytes) 2024-09-18T00:31:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:420 write 0xc35167 thru 0xc3d014 (0x7eae bytes) 2024-09-18T00:31:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:422 writesame 0xb2a1830 thru 0xb2a7c88 data_size 0x1(0x6459 bytes) 2024-09-18T00:31:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:423 writesame 0x9cc3933 thru 0x9cca9f9 data_size 0x1(0x70c7 bytes) 2024-09-18T00:31:57.430 INFO:teuthology.orchestra.run.smithi081.stdout:424 write 0x9c6654 thru 0x9d53a5 (0xed52 bytes) 2024-09-18T00:31:57.431 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:57.429+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:425 punch from 0x6c042b2 to 0x6c0dabd, (0x980b bytes) 2024-09-18T00:31:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:426 read 0x442db27 thru 0x442fa3b (0x1f15 bytes) 2024-09-18T00:31:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:427 read 0x8203ea0 thru 0x820992d (0x5a8e bytes) 2024-09-18T00:31:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:428 punch from 0x8fb38d2 to 0x8fc1e19, (0xe547 bytes) 2024-09-18T00:31:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:429 punch from 0x4db6f1a to 0x4dc38a1, (0xc987 bytes) 2024-09-18T00:31:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:431 clone 5 order 25 su 262144 sc 4 2024-09-18T00:31:57.467 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:31:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:31:57.467 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:31:57.467 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:57.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:31:57.559 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:57.558+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:57.621 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:31:57.621 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:31:57.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:31:57.621 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:31:57.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6517310269999999, 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.622 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:31:57.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.626 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.65135137, 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:31:57.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.650522187, 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:31:57.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:31:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6437375840000001, 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:31:57.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:31:57.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6437171180000001, 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:31:57.640 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:31:57.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:31:57.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.643693029, 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:31:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:31:57.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.641847067, 2024-09-18T00:31:57.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:31:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:31:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6417832479999999, 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:31:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.641754368, 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:31:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6417293920000002, 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:31:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6417103399999999, 2024-09-18T00:31:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:31:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:31:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6397615430000001, 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:31:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:31:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6397390860000001, 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:31:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6397106460000002, 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:31:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.639688338, 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:31:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6396678859999998, 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:31:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.638838437, 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:31:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.638797512, 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.638756265, 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:31:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.6387336000000001, 2024-09-18T00:31:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:31:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:31:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:31:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:31:57.714 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:31:57.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:31:57.716 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:57.713+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:57.816 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:57.815+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:57.821 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:57.821 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:31:57.821 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:57.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:31:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:31:57.917 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:57.916+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:57.936 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:57.936 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:57.936 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:31:57.936 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:31:57.936 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:57.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:31:57.967 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone4 from 0xb2a7c89 (overlap 0x2767d7d) to 0xbd25a5 2024-09-18T00:31:58.018 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:58.016+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:58.043 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-18T00:31:58.044 INFO:teuthology.orchestra.run.smithi081.stdout:432 read 0xa36687b thru 0xa367bf4 (0x137a bytes) 2024-09-18T00:31:58.045 INFO:teuthology.orchestra.run.smithi081.stdout:433 read 0xa75b5ff thru 0xa75ef32 (0x3934 bytes) 2024-09-18T00:31:58.045 INFO:teuthology.orchestra.run.smithi081.stdout:434 read 0x7fee047 thru 0x7ff2d41 (0x4cfb bytes) 2024-09-18T00:31:58.045 INFO:teuthology.orchestra.run.smithi081.stdout:435 writesame 0x1d308e3 thru 0x1d30a2a data_size 0x4(0x148 bytes) 2024-09-18T00:31:58.057 INFO:teuthology.orchestra.run.smithi081.stdout:436 write 0x9676ee2 thru 0x96827e6 (0xb905 bytes) 2024-09-18T00:31:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:440 trunc from 0xb2a7c89 to 0x7b37351 2024-09-18T00:31:58.096 INFO:teuthology.orchestra.run.smithi081.stdout:441 punch from 0x69a2624 to 0x69b0a67, (0xe443 bytes) 2024-09-18T00:31:58.096 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:58.096 INFO:teuthology.orchestra.run.smithi081.stdout:445 read 0x4c65f23 thru 0x4c69261 (0x333f bytes) 2024-09-18T00:31:58.096 INFO:teuthology.orchestra.run.smithi081.stdout:447 clone 6 order 21 su 65536 sc 12 2024-09-18T00:31:58.100 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7122 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 190464~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8209518519999999, 2024-09-18T00:31:58.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035116663999999999, 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7122 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2899999999999999e-07 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277625+0000", 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3999999999999999e-06 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277633+0000", 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4130000000000006e-06 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277637+0000", 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.172e-06 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312537+0000", 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034899342999999999 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312627+0000", 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0648000000000004e-05 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312740+0000", 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000112359 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7123 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 221184~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8209331620000002, 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035332513000000003, 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.106 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7123 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4400000000000001e-07 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277643+0000", 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.398e-06 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277652+0000", 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3899999999999993e-06 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277657+0000", 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7400000000000004e-06 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312778+0000", 2024-09-18T00:31:58.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035121364000000002 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312861+0000", 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3448000000000005e-05 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312974+0000", 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000112829 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7124 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 251904~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8209139309999998, 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035562763999999997, 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7124 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:58.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277663+0000", 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4169999999999999e-06 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277672+0000", 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8230000000000001e-06 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277676+0000", 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1189999999999999e-06 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313027+0000", 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035351120999999999 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313116+0000", 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9198999999999998e-05 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313224+0000", 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107753 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.115 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7353 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 32768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8181626849999999, 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034846251000000002, 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7353 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:31:58.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280414+0000", 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.906e-06 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280423+0000", 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.799e-06 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280427+0000", 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9430000000000002e-06 2024-09-18T00:31:58.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315067+0000", 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034639688000000002 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315153+0000", 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5937000000000001e-05 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315258+0000", 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105685 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7354 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.818142946, 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035063057000000002, 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.120 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7354 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280438+0000", 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8980000000000001e-06 2024-09-18T00:31:58.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280447+0000", 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7620000000000001e-06 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280455+0000", 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1000000000000004e-06 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315289+0000", 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034834175000000002 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315374+0000", 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4561999999999994e-05 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315495+0000", 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012123799999999999 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.124 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7355 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 94208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.818114955, 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035184698, 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.125 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7355 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:58.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4299999999999999e-07 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280462+0000", 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4890000000000001e-06 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280470+0000", 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7469999999999994e-06 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280474+0000", 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9689999999999996e-06 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315536+0000", 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035061267 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315582+0000", 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6758999999999997e-05 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315645+0000", 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2124000000000004e-05 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7356 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8180958230000002, 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035315234000000001, 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7356 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.15e-07 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280481+0000", 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3540000000000001e-06 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280489+0000", 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.687e-06 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280494+0000", 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1219999999999997e-06 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315664+0000", 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035170068999999998 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315703+0000", 2024-09-18T00:31:58.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9774000000000002e-05 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315794+0000", 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0913000000000002e-05 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7357 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 155648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.134 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8180768679999999, 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035509805999999998, 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7357 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.34e-07 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280500+0000", 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.376e-06 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280509+0000", 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9139999999999997e-06 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280513+0000", 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0049999999999998e-06 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315839+0000", 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035326125 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315906+0000", 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6816000000000005e-05 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316008+0000", 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000102236 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7358 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8180579749999999, 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035736118999999997, 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.139 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7358 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280519+0000", 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4020000000000001e-06 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280528+0000", 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9099999999999994e-06 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280532+0000", 2024-09-18T00:31:58.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1409999999999998e-06 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316065+0000", 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035533125999999998 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316149+0000", 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4396999999999998e-05 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316253+0000", 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010381499999999999 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7359 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8180388560000003, 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035936628999999998, 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7359 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1800000000000002e-07 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280538+0000", 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.353e-06 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280546+0000", 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.687e-06 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280550+0000", 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9299999999999996e-06 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316290+0000", 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035740174999999999 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316370+0000", 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9776000000000003e-05 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316473+0000", 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010239 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.148 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7360 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8180203050000001, 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036148172999999999, 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7360 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280556+0000", 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.269e-06 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280565+0000", 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7770000000000008e-06 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280573+0000", 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9889999999999992e-06 2024-09-18T00:31:58.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316508+0000", 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035935024000000003 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316596+0000", 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8337999999999993e-05 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316703+0000", 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000106446 2024-09-18T00:31:58.152 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7397 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 0~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.81781522, 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036164448000000002, 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.153 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7397 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280762+0000", 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5820000000000001e-06 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280770+0000", 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7250000000000003e-06 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280774+0000", 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1219999999999997e-06 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316751+0000", 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035976418000000003 2024-09-18T00:31:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316824+0000", 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3310000000000001e-05 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316924+0000", 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9951000000000006e-05 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7398 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 30720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.81779607, 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036418438999999997, 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7398 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280780+0000", 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.265e-06 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280789+0000", 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6340000000000007e-06 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280793+0000", 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0600000000000001e-06 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317017+0000", 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036223878000000001 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317105+0000", 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8398000000000003e-05 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317197+0000", 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1872000000000004e-05 2024-09-18T00:31:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7399 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 61440~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.817777483, 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036546236000000003, 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7399 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280798+0000", 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1899999999999998e-07 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280799+0000", 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.406e-06 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280808+0000", 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.755e-06 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280813+0000", 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.502e-06 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317227+0000", 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036413244999999997 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317285+0000", 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8585999999999998e-05 2024-09-18T00:31:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317344+0000", 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8423e-05 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7400 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8177571710000002, 2024-09-18T00:31:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036756206999999999, 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7400 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280820+0000", 2024-09-18T00:31:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8479999999999999e-06 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280829+0000", 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8920000000000006e-06 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280833+0000", 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0579999999999999e-06 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317395+0000", 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036562134000000003 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317468+0000", 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3045000000000003e-05 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317574+0000", 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0001059 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7401 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8177373819999998, 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036942361999999999, 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7401 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280838+0000", 2024-09-18T00:31:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.34e-07 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280840+0000", 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0200000000000001e-06 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280848+0000", 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2740000000000007e-06 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280852+0000", 2024-09-18T00:31:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0820000000000001e-06 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317630+0000", 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036777720999999999 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317706+0000", 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6415000000000006e-05 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317780+0000", 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3516000000000006e-05 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7402 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 153600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8177182589999998, 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037129595000000001, 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7402 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4900000000000001e-07 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280859+0000", 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9069999999999999e-06 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280868+0000", 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8769999999999999e-06 2024-09-18T00:31:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280872+0000", 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0130000000000004e-06 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317825+0000", 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036953565000000001 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317921+0000", 2024-09-18T00:31:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5680000000000005e-05 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317986+0000", 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5203999999999994e-05 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7403 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 184320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.817694725, 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037274802000000003, 2024-09-18T00:31:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7403 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8299999999999998e-07 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280882+0000", 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.443e-06 2024-09-18T00:31:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280887+0000", 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0459999999999996e-06 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280891+0000", 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4429999999999996e-06 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318016+0000", 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037124181999999999 2024-09-18T00:31:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318075+0000", 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9197000000000003e-05 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318155+0000", 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0208000000000002e-05 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7404 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8176781750000002, 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037392851999999997, 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7404 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280898+0000", 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4890000000000001e-06 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280903+0000", 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8779999999999997e-06 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280908+0000", 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.605e-06 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318192+0000", 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037284099000000001 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318237+0000", 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5429999999999997e-05 2024-09-18T00:31:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318290+0000", 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2049000000000003e-05 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7405 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 3.8176601059999999, 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037501131, 2024-09-18T00:31:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7405 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7599999999999998e-07 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280920+0000", 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9099999999999996e-06 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280926+0000", 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2049999999999999e-06 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280931+0000", 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000003e-06 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318315+0000", 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037383779999999998 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318372+0000", 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6671e-05 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318416+0000", 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4178999999999998e-05 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.192 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:58.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:31:58.194 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:58.192+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:58.294 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:58.293+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:58.339 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:58.339 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:58.339 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:31:58.340 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:58.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:31:58.395 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:58.394+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:58.489 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:58.489 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:58.489 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:31:58.489 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:31:58.490 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:58.496 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:58.494+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:58.497 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:31:58.596 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:58.595+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8394723209999997, 2024-09-18T00:31:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8375418779999997, 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:31:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:31:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8375235380000001, 2024-09-18T00:31:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:31:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8359328169999998, 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:31:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:31:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:31:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8358895840000002, 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8356914370000004, 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:31:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8355370449999997, 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:31:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8353232999999998, 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:31:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8351249049999998, 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:31:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:31:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8347640570000001, 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:31:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:31:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:31:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:31:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:31:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:31:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:31:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:31:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:31:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:31:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:31:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:31:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:31:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:31:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:31:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:31:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.831483059, 2024-09-18T00:31:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:31:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:31:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:31:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:31:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:31:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:31:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:31:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:31:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:31:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:31:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:31:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:31:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:31:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:31:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:31:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8314638839999997, 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8296047800000004, 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:31:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:31:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8295798830000001, 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:31:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8295593779999999, 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:31:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:31:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:31:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8295406239999998, 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:31:58.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8275203429999998, 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.731 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:31:58.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:31:58.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:31:58.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:31:58.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:31:58.736 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8275017570000003, 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.737 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:31:58.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:31:58.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:31:58.741 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.8266658439999999, 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:31:58.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.821490678, 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:58.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:31:58.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:58.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:31:58.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:31:58.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:31:58.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:58.754 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:58.756 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:31:58.756 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:58.754+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:58.856 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:58.855+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:58.901 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:58.901 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:58.901 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:31:58.901 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:58.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:31:58.990 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone5 from 0x7b37351 (overlap 0x7b37351) to 0x3d9b9a8 2024-09-18T00:31:58.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:31:58.996 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:31:58.994+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:31:59.058 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:31:59.056+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:31:59.058 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:59.059 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:31:59.059 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:31:59.059 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:31:59.059 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:59.067 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:31:59.102 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-18T00:31:59.123 INFO:teuthology.orchestra.run.smithi081.stdout:449 read 0x46bfee7 thru 0x46c6df8 (0x6f12 bytes) 2024-09-18T00:31:59.125 INFO:teuthology.orchestra.run.smithi081.stdout:450 trunc from 0x7b37351 to 0x754e644 2024-09-18T00:31:59.125 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:31:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:31:59.150 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:31:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:31:59.158 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:31:59.157+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:31:59.167 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:31:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:31:59.171 INFO:teuthology.orchestra.run.smithi081.stdout:451 punch from 0x41321ba to 0x4140193, (0xdfd9 bytes) 2024-09-18T00:31:59.171 INFO:teuthology.orchestra.run.smithi081.stdout:452 writesame 0x649bac6 thru 0x64a6970 data_size 0xf(0xaeab bytes) 2024-09-18T00:31:59.174 INFO:teuthology.orchestra.run.smithi081.stdout:453 read 0x61019b4 thru 0x61053aa (0x39f7 bytes) 2024-09-18T00:31:59.175 INFO:teuthology.orchestra.run.smithi081.stdout:455 punch from 0x6fa6b9 to 0x6fb8c5, (0x120c bytes) 2024-09-18T00:31:59.185 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:31:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:31:59.186 INFO:teuthology.orchestra.run.smithi081.stdout:456 write 0xc5a7004 thru 0xc5ae6dc (0x76d9 bytes) 2024-09-18T00:31:59.189 INFO:teuthology.orchestra.run.smithi081.stdout:457 read 0x8e489b2 thru 0x8e4e94f (0x5f9e bytes) 2024-09-18T00:31:59.189 INFO:teuthology.orchestra.run.smithi081.stdout:458 write 0xa4c2cce thru 0xa4c4f09 (0x223c bytes) 2024-09-18T00:31:59.194 INFO:teuthology.orchestra.run.smithi081.stdout:459 read 0xb70890a thru 0xb718290 (0xf987 bytes) 2024-09-18T00:31:59.194 INFO:teuthology.orchestra.run.smithi081.stdout:461 read 0xb6abfad thru 0xb6ae13f (0x2193 bytes) 2024-09-18T00:31:59.204 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:31:59.204 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:31:59.205 INFO:teuthology.orchestra.run.smithi081.stdout:462 writesame 0xeab2f91 thru 0xeabb614 data_size 0x2(0x8684 bytes) 2024-09-18T00:31:59.205 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.205 INFO:teuthology.orchestra.run.smithi081.stdout:466 write 0x954956c thru 0x9557a3f (0xe4d4 bytes) 2024-09-18T00:31:59.207 INFO:teuthology.orchestra.run.smithi081.stdout:468 write 0xcaf1161 thru 0xcaf87da (0x767a bytes) 2024-09-18T00:31:59.210 INFO:teuthology.orchestra.run.smithi081.stdout:470 punch from 0x7c8fb79 to 0x7c98dee, (0x9275 bytes) 2024-09-18T00:31:59.211 INFO:teuthology.orchestra.run.smithi081.stdout:471 write 0x2ade4f2 thru 0x2ae6b45 (0x8654 bytes) 2024-09-18T00:31:59.220 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.220 INFO:teuthology.orchestra.run.smithi081.stdout:474 read 0xc8a1822 thru 0xc8ac501 (0xace0 bytes) 2024-09-18T00:31:59.221 INFO:teuthology.orchestra.run.smithi081.stdout:475 write 0xd341a7d thru 0xd346cc9 (0x524d bytes) 2024-09-18T00:31:59.224 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:31:59.224 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:31:59.232 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:31:59.232 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:31:59.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:31:59.232 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8714217340000001, 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.233 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.234 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:31:59.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.234 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:31:59.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:31:59.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8660731970000004, 2024-09-18T00:31:59.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:31:59.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.242 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8623334719999995, 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.243 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:31:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:31:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:31:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:31:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:31:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:31:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:31:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:31:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:31:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:31:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8623091040000004, 2024-09-18T00:31:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:31:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:31:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8622965239999996, 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:31:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:31:59.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8622862480000002, 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:31:59.262 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:31:59.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:31:59.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8504320639999996, 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.268 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.269 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:31:59.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.269 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:31:59.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.273 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8504116939999999, 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:31:59.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:31:59.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.278 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8484520570000003, 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:31:59.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.283 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8484427879999998, 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:31:59.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:31:59.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:31:59.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:31:59.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.288 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.846429487, 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.289 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:31:59.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8464113260000001, 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:31:59.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8441134430000004, 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.298 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:31:59.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:31:59.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8440729930000002, 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.303 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:31:59.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.307 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.843977497, 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:31:59.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:31:59.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8424017719999997, 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.312 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:31:59.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:31:59.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:31:59.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.318 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8423810539999996, 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.319 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:31:59.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.322 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:31:59.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8423575210000003, 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.326 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.327 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:31:59.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:31:59.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:31:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:31:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:31:59.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:31:59.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.331 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:31:59.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:31:59.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:31:59.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:31:59.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:31:59.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:31:59.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:31:59.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:31:59.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:31:59.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:31:59.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.335 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8423349230000001, 2024-09-18T00:31:59.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:31:59.337 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.337 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.337 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:31:59.337 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.337 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.337 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.341 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.8403793659999996, 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:31:59.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:31:59.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:31:59.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:31:59.347 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:31:59.348 INFO:teuthology.orchestra.run.smithi081.stdout:476 trunc from 0xeabb615 to 0x85862d 2024-09-18T00:31:59.349 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:31:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:31:59.350 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:31:59.350 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:31:59.351 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:31:59.347+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:31:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:482 writesame 0xbba4b37 thru 0xbbaa54e data_size 0x3e(0x5a18 bytes) 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:483 punch from 0x974c93b to 0x974cfd4, (0x699 bytes) 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:486 punch from 0x3744504 to 0x375435d, (0xfe59 bytes) 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:492 read 0xa0c3dbc thru 0xa0d3b14 (0xfd59 bytes) 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:493 writesame 0xa9da2a7 thru 0xa9db7ad data_size 0x1(0x1507 bytes) 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:494 read 0x8925f67 thru 0x8925fa3 (0x3d bytes) 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:496 trunc from 0xbbaa54f to 0x2b955b4 2024-09-18T00:31:59.354 INFO:teuthology.orchestra.run.smithi081.stdout:498 trunc from 0x2b955b4 to 0xb2a425e 2024-09-18T00:31:59.354 INFO:teuthology.orchestra.run.smithi081.stdout:499 write 0xcced703 thru 0xccee296 (0xb94 bytes) 2024-09-18T00:31:59.364 INFO:teuthology.orchestra.run.smithi081.stdout:500 write 0xeb131ec thru 0xeb1c966 (0x977b bytes) 2024-09-18T00:31:59.368 INFO:teuthology.orchestra.run.smithi081.stdout:501 punch from 0x5ae1fd7 to 0x5ae72fd, (0x5326 bytes) 2024-09-18T00:31:59.368 INFO:teuthology.orchestra.run.smithi081.stdout:502 read 0xc9fd51 thru 0xca2425 (0x26d5 bytes) 2024-09-18T00:31:59.368 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.368 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:31:59.368 INFO:teuthology.orchestra.run.smithi081.stdout:507 punch from 0xb85c572 to 0xb86262c, (0x60ba bytes) 2024-09-18T00:31:59.373 INFO:teuthology.orchestra.run.smithi081.stdout:511 writesame 0xee57ea1 thru 0xee64175 data_size 0x1(0xc2d5 bytes) 2024-09-18T00:31:59.373 INFO:teuthology.orchestra.run.smithi081.stdout:512 write 0x7e5a348 thru 0x7e69376 (0xf02f bytes) 2024-09-18T00:31:59.377 INFO:teuthology.orchestra.run.smithi081.stdout:513 punch from 0xd2bc898 to 0xd2bfdc8, (0x3530 bytes) 2024-09-18T00:31:59.377 INFO:teuthology.orchestra.run.smithi081.stdout:514 punch from 0x4e64354 to 0x4e68a02, (0x46ae bytes) 2024-09-18T00:31:59.377 INFO:teuthology.orchestra.run.smithi081.stdout:515 read 0x49e89d5 thru 0x49f41f8 (0xb824 bytes) 2024-09-18T00:31:59.377 INFO:teuthology.orchestra.run.smithi081.stdout:516 write 0x32e1d8f thru 0x32e9759 (0x79cb bytes) 2024-09-18T00:31:59.380 INFO:teuthology.orchestra.run.smithi081.stdout:518 clone 7 order 25 su 262144 sc 8 2024-09-18T00:31:59.450 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:59.448+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:59.494 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:59.495 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:59.503 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:31:59.550 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:31:59.549+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:31:59.647 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:59.647 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:59.650 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:31:59.649+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:31:59.656 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:31:59.751 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:59.750+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:31:59.798 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:59.799 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:59.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:31:59.853 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:31:59.851+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:31:59.899 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:31:59.899 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:31:59.899 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:31:59.899 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 1.000000 2024-09-18T00:31:59.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-18T00:31:59.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:31:59.914 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:31:59.914 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:31:59.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:31:59.965 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:31:59.964+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:00.012 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone6 from 0xee64176 (overlap 0x85862d) to 0x42c316 2024-09-18T00:32:00.055 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:00.054+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:00.103 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.103 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:00.131 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-18T00:32:00.157 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:00.155+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:00.235 INFO:teuthology.orchestra.run.smithi081.stdout:519 punch from 0x5df3c8 to 0x5ee8fc, (0xf534 bytes) 2024-09-18T00:32:00.240 INFO:teuthology.orchestra.run.smithi081.stdout:522 write 0x7a9fb80 thru 0x7aad221 (0xd6a2 bytes) 2024-09-18T00:32:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.245 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.248 INFO:teuthology.orchestra.run.smithi081.stdout:523 clone 8 order 24 su 1048576 sc 14 2024-09-18T00:32:00.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:00.257 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:00.256+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:00.358 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.359 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.359 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:00.357+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:00.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:00.460 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:00.459+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:00.468 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.468 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:00.561 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:00.560+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:00.580 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.580 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:00.662 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:00.661+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:00.692 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.692 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:00.785 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:00.783+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:00.843 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:00.843 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:00.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:00.865 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:00.863+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:00.915 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-18T00:32:00.918 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:32:00.966 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:00.964+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:01.003 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:01.003 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:01.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:01.066 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:01.065+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:01.115 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:01.116 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:01.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:01.167 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:01.166+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:01.267 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:01.267 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:01.268 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:01.267+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:01.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:01.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:01.369 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:01.367+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:01.380 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:01.380 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:01.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:01.470 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:01.469+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:01.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:01.491 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:01.502 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:01.502 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:01.506 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:01.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:01.522 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:01.538 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:01.555 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:01.555 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:01.571 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:01.572 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:01.570+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:01.588 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:01.616 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:01.616 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:01.616 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:01.617 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:01.617 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:01.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:01.673 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:01.672+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:01.729 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7122 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 190464~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4497024960000005, 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035116663999999999, 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7122 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277623+0000", 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2899999999999999e-07 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277625+0000", 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3999999999999999e-06 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277633+0000", 2024-09-18T00:32:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4130000000000006e-06 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277637+0000", 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.172e-06 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312537+0000", 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034899342999999999 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312627+0000", 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0648000000000004e-05 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312740+0000", 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000112359 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7123 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 221184~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4496838060000004, 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035332513000000003, 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7123 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277642+0000", 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4400000000000001e-07 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277643+0000", 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.398e-06 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277652+0000", 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3899999999999993e-06 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277657+0000", 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7400000000000004e-06 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312778+0000", 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035121364000000002 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312861+0000", 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3448000000000005e-05 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.312974+0000", 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000112829 2024-09-18T00:32:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7124 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 251904~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4496645749999999, 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035562763999999997, 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7124 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277661+0000", 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277663+0000", 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4169999999999999e-06 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277672+0000", 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8230000000000001e-06 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.277676+0000", 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1189999999999999e-06 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313027+0000", 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035351120999999999 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313116+0000", 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9198999999999998e-05 2024-09-18T00:32:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.313224+0000", 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107753 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7353 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 32768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.446913329, 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034846251000000002, 2024-09-18T00:32:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7353 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280412+0000", 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280414+0000", 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.906e-06 2024-09-18T00:32:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280423+0000", 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.799e-06 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280427+0000", 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9430000000000002e-06 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315067+0000", 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034639688000000002 2024-09-18T00:32:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315153+0000", 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5937000000000001e-05 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315258+0000", 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105685 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7354 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4468935900000002, 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035063057000000002, 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7354 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280432+0000", 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280438+0000", 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8980000000000001e-06 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280447+0000", 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7620000000000001e-06 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280455+0000", 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1000000000000004e-06 2024-09-18T00:32:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315289+0000", 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.034834175000000002 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315374+0000", 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4561999999999994e-05 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315495+0000", 2024-09-18T00:32:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012123799999999999 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7355 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 94208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4468655989999997, 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035184698, 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7355 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:32:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280460+0000", 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4299999999999999e-07 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280462+0000", 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4890000000000001e-06 2024-09-18T00:32:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280470+0000", 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7469999999999994e-06 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280474+0000", 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9689999999999996e-06 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315536+0000", 2024-09-18T00:32:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035061267 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315582+0000", 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6758999999999997e-05 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315645+0000", 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2124000000000004e-05 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7356 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4468464670000003, 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035315234000000001, 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7356 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280479+0000", 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.15e-07 2024-09-18T00:32:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280481+0000", 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3540000000000001e-06 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280489+0000", 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.687e-06 2024-09-18T00:32:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280494+0000", 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1219999999999997e-06 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315664+0000", 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035170068999999998 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315703+0000", 2024-09-18T00:32:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9774000000000002e-05 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315794+0000", 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0913000000000002e-05 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7357 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 155648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4468275119999996, 2024-09-18T00:32:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035509805999999998, 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7357 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280498+0000", 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.34e-07 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280500+0000", 2024-09-18T00:32:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.376e-06 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280509+0000", 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9139999999999997e-06 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280513+0000", 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0049999999999998e-06 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315839+0000", 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035326125 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.315906+0000", 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6816000000000005e-05 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316008+0000", 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000102236 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7358 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4468086190000005, 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035736118999999997, 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7358 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280517+0000", 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280519+0000", 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4020000000000001e-06 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280528+0000", 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9099999999999994e-06 2024-09-18T00:32:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280532+0000", 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1409999999999998e-06 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316065+0000", 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035533125999999998 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316149+0000", 2024-09-18T00:32:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4396999999999998e-05 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316253+0000", 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010381499999999999 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7359 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:32:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4467895000000004, 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035936628999999998, 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7359 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:32:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280536+0000", 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1800000000000002e-07 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280538+0000", 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.353e-06 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280546+0000", 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.687e-06 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280550+0000", 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9299999999999996e-06 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316290+0000", 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035740174999999999 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316370+0000", 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9776000000000003e-05 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316473+0000", 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010239 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7360 3.9 3:91a40d09:::rbd_data.1197f1330e07.0000000000000009:5 [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4467709490000003, 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036148172999999999, 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7360 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280555+0000", 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280556+0000", 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.269e-06 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280565+0000", 2024-09-18T00:32:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7770000000000008e-06 2024-09-18T00:32:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280573+0000", 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9889999999999992e-06 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316508+0000", 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035935024000000003 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316596+0000", 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8337999999999993e-05 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316703+0000", 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000106446 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7397 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 0~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4465658640000001, 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036164448000000002, 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7397 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280760+0000", 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280762+0000", 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5820000000000001e-06 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280770+0000", 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7250000000000003e-06 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280774+0000", 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1219999999999997e-06 2024-09-18T00:32:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316751+0000", 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.035976418000000003 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316824+0000", 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3310000000000001e-05 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.316924+0000", 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9951000000000006e-05 2024-09-18T00:32:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7398 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 30720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4465467140000001, 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036418438999999997, 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7398 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280779+0000", 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280780+0000", 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.265e-06 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280789+0000", 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6340000000000007e-06 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280793+0000", 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0600000000000001e-06 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317017+0000", 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036223878000000001 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317105+0000", 2024-09-18T00:32:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8398000000000003e-05 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317197+0000", 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1872000000000004e-05 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7399 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 61440~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4465281269999997, 2024-09-18T00:32:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036546236000000003, 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7399 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280797+0000", 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280798+0000", 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1899999999999998e-07 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280799+0000", 2024-09-18T00:32:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.406e-06 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280808+0000", 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.755e-06 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280813+0000", 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.502e-06 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317227+0000", 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036413244999999997 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317285+0000", 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8585999999999998e-05 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317344+0000", 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8423e-05 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7400 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4465078150000004, 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036756206999999999, 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.794 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7400 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280818+0000", 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280820+0000", 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8479999999999999e-06 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280829+0000", 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8920000000000006e-06 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280833+0000", 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0579999999999999e-06 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317395+0000", 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036562134000000003 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317468+0000", 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3045000000000003e-05 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317574+0000", 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0001059 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7401 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4464880259999999, 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036942361999999999, 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.798 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7401 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280837+0000", 2024-09-18T00:32:01.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280838+0000", 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.34e-07 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280840+0000", 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0200000000000001e-06 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280848+0000", 2024-09-18T00:32:01.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2740000000000007e-06 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280852+0000", 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0820000000000001e-06 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317630+0000", 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036777720999999999 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317706+0000", 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6415000000000006e-05 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317780+0000", 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3516000000000006e-05 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7402 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 153600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:32:01.802 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4464689029999995, 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037129595000000001, 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7402 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280857+0000", 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4900000000000001e-07 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280859+0000", 2024-09-18T00:32:01.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9069999999999999e-06 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280868+0000", 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8769999999999999e-06 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280872+0000", 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0130000000000004e-06 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317825+0000", 2024-09-18T00:32:01.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.036953565000000001 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317921+0000", 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5680000000000005e-05 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.317986+0000", 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5203999999999994e-05 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7403 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 184320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4464453690000001, 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037274802000000003, 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7403 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.807 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280880+0000", 2024-09-18T00:32:01.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8299999999999998e-07 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280882+0000", 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.443e-06 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280887+0000", 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0459999999999996e-06 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280891+0000", 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4429999999999996e-06 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318016+0000", 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037124181999999999 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318075+0000", 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9197000000000003e-05 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318155+0000", 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0208000000000002e-05 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7404 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4464288190000003, 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037392851999999997, 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.811 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7404 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:32:01.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280897+0000", 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280898+0000", 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.4890000000000001e-06 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280903+0000", 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8779999999999997e-06 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280908+0000", 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.605e-06 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318192+0000", 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037284099000000001 2024-09-18T00:32:01.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318237+0000", 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5429999999999997e-05 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318290+0000", 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2049000000000003e-05 2024-09-18T00:32:01.815 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:7405 3.9 3:94d174f0:::rbd_data.1197f1330e07.000000000000000e:5 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 7.4464107500000001, 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037501131, 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:01.816 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 7405 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280915+0000", 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7599999999999998e-07 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280920+0000", 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9099999999999996e-06 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280926+0000", 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2049999999999999e-06 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.280931+0000", 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000003e-06 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318315+0000", 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.037383779999999998 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318372+0000", 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6671e-05 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:01.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:54.318416+0000", 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4178999999999998e-05 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:01.820 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:01.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:01.822 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:01.820+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:01.923 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:01.921+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:01.929 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:01.929 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:01.929 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:01.929 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:01.939 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:01.969 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone7 from 0xee64176 (overlap 0xee64176) to 0x77320bb 2024-09-18T00:32:02.024 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:02.023+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:02.051 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:02.051 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:02.051 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:02.051 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:02.051 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:02.059 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:02.143 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:02.142+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:02.153 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-18T00:32:02.162 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.162 INFO:teuthology.orchestra.run.smithi081.stdout:525 write 0x6af26ec thru 0x6afea96 (0xc3ab bytes) 2024-09-18T00:32:02.174 INFO:teuthology.orchestra.run.smithi081.stdout:526 write 0xd06ab90 thru 0xd07223a (0x76ab bytes) 2024-09-18T00:32:02.181 INFO:teuthology.orchestra.run.smithi081.stdout:527 punch from 0x70f5303 to 0x70f91be, (0x3ebb bytes) 2024-09-18T00:32:02.181 INFO:teuthology.orchestra.run.smithi081.stdout:529 write 0xe4641ee thru 0xe464bd3 (0x9e6 bytes) 2024-09-18T00:32:02.184 INFO:teuthology.orchestra.run.smithi081.stdout:530 writesame 0x6a2d7aa thru 0x6a33a92 data_size 0x1(0x62e9 bytes) 2024-09-18T00:32:02.197 INFO:teuthology.orchestra.run.smithi081.stdout:532 write 0x6ca33b6 thru 0x6caa249 (0x6e94 bytes) 2024-09-18T00:32:02.204 INFO:teuthology.orchestra.run.smithi081.stdout:533 writesame 0xecc02ab thru 0xecc7f67 data_size 0x1(0x7cbd bytes) 2024-09-18T00:32:02.211 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:02.211 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:02.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:02.211 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4082301449999992, 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:02.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4062997020000001, 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4062813619999996, 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4046906410000002, 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.228 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4046474080000007, 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.229 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.234 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4044492609999999, 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4042948689999992, 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.239 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:02.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4040811239999993, 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:02.243 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:02.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:02.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4038827289999993, 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.251 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4035218809999996, 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.252 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:02.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4002408830000004, 2024-09-18T00:32:02.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.260 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.4002217080000001, 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.261 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.262 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3983626040000008, 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.265 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.269 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3983377069999996, 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:02.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:02.273 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3983172019999994, 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.274 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:02.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.278 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3982984480000002, 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:02.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:02.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3962781670000002, 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.283 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:02.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3962595810000007, 2024-09-18T00:32:02.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:02.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:02.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3954236679999994, 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:02.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:02.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.3902485020000004, 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.296 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:02.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:02.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.300 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.301 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:02.302 INFO:teuthology.orchestra.run.smithi081.stdout:534 write 0xb62c48b thru 0xb634b49 (0x86bf bytes) 2024-09-18T00:32:02.302 INFO:teuthology.orchestra.run.smithi081.stdout:535 writesame 0xa8b0838 thru 0xa8b58e0 data_size 0x1(0x50a9 bytes) 2024-09-18T00:32:02.302 INFO:teuthology.orchestra.run.smithi081.stdout:536 trunc from 0xee64176 to 0x6aaacd5 2024-09-18T00:32:02.302 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:02.300+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:02.303 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:02.303 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.303 INFO:teuthology.orchestra.run.smithi081.stdout:540 writesame 0x4e7ea94 thru 0x4e82b0d data_size 0x2a(0x407a bytes) 2024-09-18T00:32:02.304 INFO:teuthology.orchestra.run.smithi081.stdout:541 write 0x26f063f thru 0x26fe8c5 (0xe287 bytes) 2024-09-18T00:32:02.306 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.306 INFO:teuthology.orchestra.run.smithi081.stdout:548 read 0x10f778b thru 0x10f79a9 (0x21f bytes) 2024-09-18T00:32:02.310 INFO:teuthology.orchestra.run.smithi081.stdout:549 trunc from 0x6aaacd5 to 0x9ed46f0 2024-09-18T00:32:02.315 INFO:teuthology.orchestra.run.smithi081.stdout:553 read 0x7ff840f thru 0x7ffb4fa (0x30ec bytes) 2024-09-18T00:32:02.327 INFO:teuthology.orchestra.run.smithi081.stdout:556 writesame 0xec2b000 thru 0xec39fdc data_size 0x1(0xefdd bytes) 2024-09-18T00:32:02.327 INFO:teuthology.orchestra.run.smithi081.stdout:558 punch from 0x29d1a5a to 0x29dbaa5, (0xa04b bytes) 2024-09-18T00:32:02.327 INFO:teuthology.orchestra.run.smithi081.stdout:559 write 0x3e5e524 thru 0x3e621e4 (0x3cc1 bytes) 2024-09-18T00:32:02.328 INFO:teuthology.orchestra.run.smithi081.stdout:560 read 0xcc2b9d7 thru 0xcc3907c (0xd6a6 bytes) 2024-09-18T00:32:02.343 INFO:teuthology.orchestra.run.smithi081.stdout:561 trunc from 0xec39fdd to 0x2a2b1b7 2024-09-18T00:32:02.350 INFO:teuthology.orchestra.run.smithi081.stdout:562 read 0x24fb511 thru 0x2505f05 (0xa9f5 bytes) 2024-09-18T00:32:02.351 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.351 INFO:teuthology.orchestra.run.smithi081.stdout:565 write 0xb537c5 thru 0xb5c1c2 (0x89fe bytes) 2024-09-18T00:32:02.362 INFO:teuthology.orchestra.run.smithi081.stdout:567 writesame 0x5015cc1 thru 0x501663c data_size 0x2(0x97c bytes) 2024-09-18T00:32:02.363 INFO:teuthology.orchestra.run.smithi081.stdout:568 punch from 0x1d89731 to 0x1d8ac52, (0x1521 bytes) 2024-09-18T00:32:02.363 INFO:teuthology.orchestra.run.smithi081.stdout:569 write 0x187402e thru 0x18740be (0x91 bytes) 2024-09-18T00:32:02.364 INFO:teuthology.orchestra.run.smithi081.stdout:570 write 0x3ec6315 thru 0x3ecb72f (0x541b bytes) 2024-09-18T00:32:02.365 INFO:teuthology.orchestra.run.smithi081.stdout:571 read 0xde7dd6 thru 0xde934f (0x157a bytes) 2024-09-18T00:32:02.369 INFO:teuthology.orchestra.run.smithi081.stdout:572 trunc from 0x501663d to 0x22837d7 2024-09-18T00:32:02.379 INFO:teuthology.orchestra.run.smithi081.stdout:573 read 0x14f3c93 thru 0x14f5bc4 (0x1f32 bytes) 2024-09-18T00:32:02.394 INFO:teuthology.orchestra.run.smithi081.stdout:575 write 0x8976e5b thru 0x897abe3 (0x3d89 bytes) 2024-09-18T00:32:02.395 INFO:teuthology.orchestra.run.smithi081.stdout:576 punch from 0x1755203 to 0x175f3ef, (0xa1ec bytes) 2024-09-18T00:32:02.395 INFO:teuthology.orchestra.run.smithi081.stdout:577 read 0x11e081 thru 0x1219b4 (0x3934 bytes) 2024-09-18T00:32:02.402 INFO:teuthology.orchestra.run.smithi081.stdout:579 trunc from 0x897abe4 to 0x3b2eea8 2024-09-18T00:32:02.403 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:02.401+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:02.418 INFO:teuthology.orchestra.run.smithi081.stdout:580 trunc from 0x3b2eea8 to 0xaeb8301 2024-09-18T00:32:02.423 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.432 INFO:teuthology.orchestra.run.smithi081.stdout:582 writesame 0xeaa6156 thru 0xeaa8dbf data_size 0xa(0x2c6a bytes) 2024-09-18T00:32:02.433 INFO:teuthology.orchestra.run.smithi081.stdout:583 read 0x6dbfb8a thru 0x6dc4d47 (0x51be bytes) 2024-09-18T00:32:02.433 INFO:teuthology.orchestra.run.smithi081.stdout:584 read 0xc4d13b3 thru 0xc4d4788 (0x33d6 bytes) 2024-09-18T00:32:02.433 INFO:teuthology.orchestra.run.smithi081.stdout:585 read 0xd00b84a thru 0xd015fcc (0xa783 bytes) 2024-09-18T00:32:02.448 INFO:teuthology.orchestra.run.smithi081.stdout:587 trunc from 0xeaa8dc0 to 0x1d3d938 2024-09-18T00:32:02.454 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:02.454 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:02.454 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:02.454 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:02.459 INFO:teuthology.orchestra.run.smithi081.stdout:589 writesame 0x18235a5 thru 0x1832223 data_size 0x1f(0xec7f bytes) 2024-09-18T00:32:02.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:02.470 INFO:teuthology.orchestra.run.smithi081.stdout:590 writesame 0x3e2302d thru 0x3e27906 data_size 0x5(0x48da bytes) 2024-09-18T00:32:02.471 INFO:teuthology.orchestra.run.smithi081.stdout:592 writesame 0x396d600 thru 0x3970572 data_size 0x1(0x2f73 bytes) 2024-09-18T00:32:02.489 INFO:teuthology.orchestra.run.smithi081.stdout:593 writesame 0x6da3953 thru 0x6da7618 data_size 0x3(0x3cc6 bytes) 2024-09-18T00:32:02.491 INFO:teuthology.orchestra.run.smithi081.stdout:595 read 0x1209488 thru 0x120e73d (0x52b6 bytes) 2024-09-18T00:32:02.491 INFO:teuthology.orchestra.run.smithi081.stdout:597 read 0x2710ef8 thru 0x271cdfd (0xbf06 bytes) 2024-09-18T00:32:02.491 INFO:teuthology.orchestra.run.smithi081.stdout:598 writesame 0x6accd57 thru 0x6ace692 data_size 0x14(0x193c bytes) 2024-09-18T00:32:02.492 INFO:teuthology.orchestra.run.smithi081.stdout:599 read 0x4bbb587 thru 0x4bbcaa9 (0x1523 bytes) 2024-09-18T00:32:02.492 INFO:teuthology.orchestra.run.smithi081.stdout:600 read 0x13bbd91 thru 0x13c8617 (0xc887 bytes) 2024-09-18T00:32:02.493 INFO:teuthology.orchestra.run.smithi081.stdout:601 read 0x2894c95 thru 0x289594f (0xcbb bytes) 2024-09-18T00:32:02.498 INFO:teuthology.orchestra.run.smithi081.stdout:602 trunc from 0x6da7619 to 0x2903c62 2024-09-18T00:32:02.503 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:02.502+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:02.517 INFO:teuthology.orchestra.run.smithi081.stdout:603 writesame 0x569ada7 thru 0x569c251 data_size 0xd(0x14ab bytes) 2024-09-18T00:32:02.527 INFO:teuthology.orchestra.run.smithi081.stdout:605 trunc from 0x569c252 to 0xcb64fb6 2024-09-18T00:32:02.532 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.533 INFO:teuthology.orchestra.run.smithi081.stdout:607 read 0x1ac1506 thru 0x1acff21 (0xea1c bytes) 2024-09-18T00:32:02.533 INFO:teuthology.orchestra.run.smithi081.stdout:608 write 0xca96b1a thru 0xcaa477a (0xdc61 bytes) 2024-09-18T00:32:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:610 write 0x8cb373e thru 0x8cbe299 (0xab5c bytes) 2024-09-18T00:32:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:611 write 0xa76aa7a thru 0xa775e25 (0xb3ac bytes) 2024-09-18T00:32:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:612 writesame 0x23bd857 thru 0x23c1d6c data_size 0x25(0x4516 bytes) 2024-09-18T00:32:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:613 punch from 0x392b5df to 0x39310ba, (0x5adb bytes) 2024-09-18T00:32:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:615 write 0x5fe6e12 thru 0x5feadd0 (0x3fbf bytes) 2024-09-18T00:32:02.543 INFO:teuthology.orchestra.run.smithi081.stdout:616 trunc from 0xcb64fb6 to 0xb00c779 2024-09-18T00:32:02.551 INFO:teuthology.orchestra.run.smithi081.stdout:617 write 0x71d5106 thru 0x71da176 (0x5071 bytes) 2024-09-18T00:32:02.552 INFO:teuthology.orchestra.run.smithi081.stdout:618 write 0x4d12f5d thru 0x4d1683a (0x38de bytes) 2024-09-18T00:32:02.554 INFO:teuthology.orchestra.run.smithi081.stdout:619 read 0xb91820 thru 0xb9960c (0x7ded bytes) 2024-09-18T00:32:02.554 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.554 INFO:teuthology.orchestra.run.smithi081.stdout:622 punch from 0x31b713 to 0x31f605, (0x3ef2 bytes) 2024-09-18T00:32:02.554 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.554 INFO:teuthology.orchestra.run.smithi081.stdout:624 punch from 0x7f8cef9 to 0x7f8dd49, (0xe50 bytes) 2024-09-18T00:32:02.564 INFO:teuthology.orchestra.run.smithi081.stdout:625 trunc from 0xb00c779 to 0x2f470c1 2024-09-18T00:32:02.572 INFO:teuthology.orchestra.run.smithi081.stdout:627 read 0x183810e thru 0x183c31f (0x4212 bytes) 2024-09-18T00:32:02.572 INFO:teuthology.orchestra.run.smithi081.stdout:628 read 0x9016ac thru 0x90acbf (0x9614 bytes) 2024-09-18T00:32:02.573 INFO:teuthology.orchestra.run.smithi081.stdout:631 punch from 0xbab69e to 0xbb7083, (0xb9e5 bytes) 2024-09-18T00:32:02.573 INFO:teuthology.orchestra.run.smithi081.stdout:633 read 0x2bd204c thru 0x2bd955a (0x750f bytes) 2024-09-18T00:32:02.586 INFO:teuthology.orchestra.run.smithi081.stdout:634 writesame 0x939c732 thru 0x93a1e3a data_size 0x1(0x5709 bytes) 2024-09-18T00:32:02.587 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.587 INFO:teuthology.orchestra.run.smithi081.stdout:636 read 0x22c8ff0 thru 0x22cd09d (0x40ae bytes) 2024-09-18T00:32:02.595 INFO:teuthology.orchestra.run.smithi081.stdout:637 write 0xa6a7634 thru 0xa6b1503 (0x9ed0 bytes) 2024-09-18T00:32:02.601 INFO:teuthology.orchestra.run.smithi081.stdout:639 trunc from 0xa6b1504 to 0x68dd96a 2024-09-18T00:32:02.604 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:02.602+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:02.609 INFO:teuthology.orchestra.run.smithi081.stdout:640 write 0xbbf8e4 thru 0xbce97a (0xf097 bytes) 2024-09-18T00:32:02.610 INFO:teuthology.orchestra.run.smithi081.stdout:642 write 0x2e7d01a thru 0x2e8c6ba (0xf6a1 bytes) 2024-09-18T00:32:02.613 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:02.613 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:02.613 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:02.613 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:02.613 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:02.621 INFO:teuthology.orchestra.run.smithi081.stdout:643 trunc from 0x68dd96a to 0xdfac2e0 2024-09-18T00:32:02.622 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:02.626 INFO:teuthology.orchestra.run.smithi081.stdout:644 read 0x96be15d thru 0x96c2a89 (0x492d bytes) 2024-09-18T00:32:02.627 INFO:teuthology.orchestra.run.smithi081.stdout:645 read 0xba8b50 thru 0xbadc99 (0x514a bytes) 2024-09-18T00:32:02.627 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.627 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.627 INFO:teuthology.orchestra.run.smithi081.stdout:651 read 0x5d3d554 thru 0x5d46a12 (0x94bf bytes) 2024-09-18T00:32:02.627 INFO:teuthology.orchestra.run.smithi081.stdout:653 read 0x6111f3b thru 0x611aca8 (0x8d6e bytes) 2024-09-18T00:32:02.628 INFO:teuthology.orchestra.run.smithi081.stdout:654 writesame 0xde5b732 thru 0xde63bea data_size 0x1(0x84b9 bytes) 2024-09-18T00:32:02.649 INFO:teuthology.orchestra.run.smithi081.stdout:656 punch from 0xc2b5d1d to 0xc2c03cc, (0xa6af bytes) 2024-09-18T00:32:02.655 INFO:teuthology.orchestra.run.smithi081.stdout:657 trunc from 0xdfac2e0 to 0x8e98e94 2024-09-18T00:32:02.663 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.672 INFO:teuthology.orchestra.run.smithi081.stdout:660 write 0xab257fc thru 0xab27669 (0x1e6e bytes) 2024-09-18T00:32:02.673 INFO:teuthology.orchestra.run.smithi081.stdout:662 read 0x63505a4 thru 0x6358934 (0x8391 bytes) 2024-09-18T00:32:02.674 INFO:teuthology.orchestra.run.smithi081.stdout:663 punch from 0x385bde8 to 0x3866908, (0xab20 bytes) 2024-09-18T00:32:02.674 INFO:teuthology.orchestra.run.smithi081.stdout:664 write 0x4710580 thru 0x471d521 (0xcfa2 bytes) 2024-09-18T00:32:02.683 INFO:teuthology.orchestra.run.smithi081.stdout:665 write 0xce488c6 thru 0xce49041 (0x77c bytes) 2024-09-18T00:32:02.691 INFO:teuthology.orchestra.run.smithi081.stdout:666 trunc from 0xce49042 to 0x71dbd94 2024-09-18T00:32:02.699 INFO:teuthology.orchestra.run.smithi081.stdout:667 read 0x119148a thru 0x119b4a8 (0xa01f bytes) 2024-09-18T00:32:02.700 INFO:teuthology.orchestra.run.smithi081.stdout:668 read 0x32d9335 thru 0x32df333 (0x5fff bytes) 2024-09-18T00:32:02.701 INFO:teuthology.orchestra.run.smithi081.stdout:669 read 0x629a83c thru 0x62a1b2c (0x72f1 bytes) 2024-09-18T00:32:02.701 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.701 INFO:teuthology.orchestra.run.smithi081.stdout:674 punch from 0x6de65f6 to 0x6df04cb, (0x9ed5 bytes) 2024-09-18T00:32:02.701 INFO:teuthology.orchestra.run.smithi081.stdout:675 write 0x6641ee7 thru 0x6645c7b (0x3d95 bytes) 2024-09-18T00:32:02.702 INFO:teuthology.orchestra.run.smithi081.stdout:676 read 0x5713a8e thru 0x571a851 (0x6dc4 bytes) 2024-09-18T00:32:02.703 INFO:teuthology.orchestra.run.smithi081.stdout:677 read 0x5619300 thru 0x561ff63 (0x6c64 bytes) 2024-09-18T00:32:02.703 INFO:teuthology.orchestra.run.smithi081.stdout:678 write 0x6c9fb18 thru 0x6ca4e55 (0x533e bytes) 2024-09-18T00:32:02.704 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:02.703+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:02.705 INFO:teuthology.orchestra.run.smithi081.stdout:679 writesame 0x32aad76 thru 0x32ab621 data_size 0xa(0x8ac bytes) 2024-09-18T00:32:02.706 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.706 INFO:teuthology.orchestra.run.smithi081.stdout:681 punch from 0x650caf3 to 0x650ddfc, (0x1309 bytes) 2024-09-18T00:32:02.715 INFO:teuthology.orchestra.run.smithi081.stdout:682 write 0xa06c0b6 thru 0xa074798 (0x86e3 bytes) 2024-09-18T00:32:02.717 INFO:teuthology.orchestra.run.smithi081.stdout:684 writesame 0xc207c thru 0xd17f9 data_size 0x4f(0xf77e bytes) 2024-09-18T00:32:02.728 INFO:teuthology.orchestra.run.smithi081.stdout:685 trunc from 0xa074799 to 0x25c5e1a 2024-09-18T00:32:02.737 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:02.737 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:02.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:02.737 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.376999348, 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.738 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.742 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.371650811, 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:02.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:02.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.367911085999999, 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:02.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.749 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.367886717999999, 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.753 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:02.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:02.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.367874137999999, 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:02.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:02.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.367863862, 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.766 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.356009677999999, 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:02.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:02.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.355989308, 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.771 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:02.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:02.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.354029670999999, 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:02.775 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:02.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.779 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.354020402, 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.780 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:02.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.352007101, 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.35198894, 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:02.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:02.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.349691056999999, 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:02.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.349650606999999, 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.349555111000001, 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:02.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:02.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.347979386, 2024-09-18T00:32:02.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:02.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.812 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.347958668, 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:02.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.347935135, 2024-09-18T00:32:02.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:02.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.821 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.347912536999999, 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:02.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.34595698, 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.832 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:02.834 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:02.836 INFO:teuthology.orchestra.run.smithi081.stdout:688 writesame 0x373cb2e thru 0x37425c3 data_size 0xf(0x5a96 bytes) 2024-09-18T00:32:02.836 INFO:teuthology.orchestra.run.smithi081.stdout:689 punch from 0x363ef0e to 0x3643803, (0x48f5 bytes) 2024-09-18T00:32:02.836 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.836 INFO:teuthology.orchestra.run.smithi081.stdout:691 write 0x48bac52 thru 0x48bcd3d (0x20ec bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:693 punch from 0x1e0faf4 to 0x1e16fa1, (0x74ad bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:695 read 0x185c8c0 thru 0x1868c56 (0xc397 bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:699 read 0x231799d thru 0x231ad1a (0x337e bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:702 trunc from 0x48bcd3e to 0xb51520b 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:703 read 0x8533ad9 thru 0x8539d6c (0x6294 bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:704 write 0x47feaff thru 0x480d643 (0xeb45 bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:705 write 0x66deef thru 0x6780b2 (0xa1c4 bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:706 write 0x5e3b096 thru 0x5e45b34 (0xaa9f bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:707 write 0xd6e65c0 thru 0xd6f0f47 (0xa988 bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:710 write 0x9fc4427 thru 0x9fd1c61 (0xd83b bytes) 2024-09-18T00:32:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:711 read 0x612f396 thru 0x61355d0 (0x623b bytes) 2024-09-18T00:32:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:712 write 0xdc6afd1 thru 0xdc7ad17 (0xfd47 bytes) 2024-09-18T00:32:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:713 trunc from 0xdc7ad18 to 0xc4ec8f1 2024-09-18T00:32:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:715 writesame 0xe1177d thru 0xe1c670 data_size 0x2(0xaef4 bytes) 2024-09-18T00:32:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:716 trunc from 0xc4ec8f1 to 0xdb18c00 2024-09-18T00:32:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:717 trunc from 0xdb18c00 to 0x83850d5 2024-09-18T00:32:02.838 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:02.832+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:02.848 INFO:teuthology.orchestra.run.smithi081.stdout:718 write 0xb99a99d thru 0xb9a7e39 (0xd49d bytes) 2024-09-18T00:32:02.850 INFO:teuthology.orchestra.run.smithi081.stdout:719 trunc from 0xb9a7e3a to 0xc9bb5be 2024-09-18T00:32:02.856 INFO:teuthology.orchestra.run.smithi081.stdout:720 punch from 0x2a7e92f to 0x2a7ff11, (0x15e2 bytes) 2024-09-18T00:32:02.856 INFO:teuthology.orchestra.run.smithi081.stdout:721 read 0xcdd7f0 thru 0xce8f7f (0xb790 bytes) 2024-09-18T00:32:02.856 INFO:teuthology.orchestra.run.smithi081.stdout:722 punch from 0xb2bae15 to 0xb2bf354, (0x453f bytes) 2024-09-18T00:32:02.856 INFO:teuthology.orchestra.run.smithi081.stdout:723 writesame 0x25fd2c thru 0x2692b2 data_size 0x1(0x9587 bytes) 2024-09-18T00:32:02.880 INFO:teuthology.orchestra.run.smithi081.stdout:724 writesame 0x3796e7e thru 0x379d082 data_size 0x1(0x6205 bytes) 2024-09-18T00:32:02.895 INFO:teuthology.orchestra.run.smithi081.stdout:726 write 0x73c88ac thru 0x73d83b0 (0xfb05 bytes) 2024-09-18T00:32:02.905 INFO:teuthology.orchestra.run.smithi081.stdout:730 trunc from 0xc9bb5be to 0x59efb24 2024-09-18T00:32:02.922 INFO:teuthology.orchestra.run.smithi081.stdout:731 trunc from 0x59efb24 to 0x2894171 2024-09-18T00:32:02.935 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:02.933+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:02.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:32:02.940 INFO:teuthology.orchestra.run.smithi081.stdout:732 trunc from 0x2894171 to 0xadf6660 2024-09-18T00:32:02.946 INFO:teuthology.orchestra.run.smithi081.stdout:734 write 0x199ba6b thru 0x19a3526 (0x7abc bytes) 2024-09-18T00:32:02.947 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:02.947 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:02.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.947 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_repop(client.4503.0:16373 3.12 e39/23 3:4bc41da5:::rbd_data.1197c78141c8.000000000000000b:head v 39'78, mlcod=39'76)", 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:02.946234+0000", 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.00048799200000000003, 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00050330999999999998, 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946234+0000", 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946234+0000", 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946235+0000", 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.23e-07 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946253+0000", 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8102e-05 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946263+0000", 2024-09-18T00:32:02.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0271999999999999e-05 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946269+0000", 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2419999999999997e-06 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946304+0000", 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4805000000000003e-05 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:02.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:02.946316+0000", 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1848000000000001e-05 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 1 2024-09-18T00:32:02.952 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:735 writesame 0x8b72c05 thru 0x8b81fc4 data_size 0x41(0xf3c0 bytes) 2024-09-18T00:32:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:737 trunc from 0xadf6660 to 0xd784d95 2024-09-18T00:32:02.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:02.959 INFO:teuthology.orchestra.run.smithi081.stdout:738 write 0xd135abe thru 0xd1395eb (0x3b2e bytes) 2024-09-18T00:32:02.960 INFO:teuthology.orchestra.run.smithi081.stdout:739 read 0xcc339aa thru 0xcc38791 (0x4de8 bytes) 2024-09-18T00:32:02.965 INFO:teuthology.orchestra.run.smithi081.stdout:741 trunc from 0xd784d95 to 0x9ccabe1 2024-09-18T00:32:02.976 INFO:teuthology.orchestra.run.smithi081.stdout:742 write 0x19263dc thru 0x1926ff0 (0xc15 bytes) 2024-09-18T00:32:02.977 INFO:teuthology.orchestra.run.smithi081.stdout:743 write 0x8219d39 thru 0x82264c6 (0xc78e bytes) 2024-09-18T00:32:02.980 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:02.990 INFO:teuthology.orchestra.run.smithi081.stdout:745 write 0xdc6c06f thru 0xdc7225d (0x61ef bytes) 2024-09-18T00:32:02.992 INFO:teuthology.orchestra.run.smithi081.stdout:746 read 0x9eacfe1 thru 0x9ebbbe9 (0xec09 bytes) 2024-09-18T00:32:02.992 INFO:teuthology.orchestra.run.smithi081.stdout:747 write 0x4e83cdc thru 0x4e8a948 (0x6c6d bytes) 2024-09-18T00:32:02.994 INFO:teuthology.orchestra.run.smithi081.stdout:748 read 0xccb9f24 thru 0xccc7208 (0xd2e5 bytes) 2024-09-18T00:32:02.994 INFO:teuthology.orchestra.run.smithi081.stdout:749 write 0x1ac4c53 thru 0x1ac6efb (0x22a9 bytes) 2024-09-18T00:32:02.996 INFO:teuthology.orchestra.run.smithi081.stdout:754 writesame 0x6553836 thru 0x655ac5b data_size 0x1(0x7426 bytes) 2024-09-18T00:32:03.016 INFO:teuthology.orchestra.run.smithi081.stdout:758 writesame 0x713d0d9 thru 0x713d3d4 data_size 0x2(0x2fc bytes) 2024-09-18T00:32:03.033 INFO:teuthology.orchestra.run.smithi081.stdout:759 trunc from 0xdc7225e to 0x28bb1c1 2024-09-18T00:32:03.036 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:03.034+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:03.059 INFO:teuthology.orchestra.run.smithi081.stdout:760 writesame 0xcbacee2 thru 0xcbb4c63 data_size 0x12(0x7d82 bytes) 2024-09-18T00:32:03.060 INFO:teuthology.orchestra.run.smithi081.stdout:761 read 0x3916675 thru 0x391c7da (0x6166 bytes) 2024-09-18T00:32:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:763 punch from 0x44b0d88 to 0x44b4de5, (0x405d bytes) 2024-09-18T00:32:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:766 punch from 0x9ef7a43 to 0x9efddce, (0x638b bytes) 2024-09-18T00:32:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:767 read 0x5431acb thru 0x5438357 (0x688d bytes) 2024-09-18T00:32:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:768 punch from 0x52211ec to 0x522be52, (0xac66 bytes) 2024-09-18T00:32:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:769 write 0x1558951 thru 0x15671d9 (0xe889 bytes) 2024-09-18T00:32:03.063 INFO:teuthology.orchestra.run.smithi081.stdout:772 read 0x7208ee6 thru 0x720f26d (0x6388 bytes) 2024-09-18T00:32:03.063 INFO:teuthology.orchestra.run.smithi081.stdout:773 read 0x603f641 thru 0x6047765 (0x8125 bytes) 2024-09-18T00:32:03.063 INFO:teuthology.orchestra.run.smithi081.stdout:775 write 0x29f006 thru 0x2a9af8 (0xaaf3 bytes) 2024-09-18T00:32:03.066 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:03.066 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:03.066 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:03.066 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:03.066 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:03.074 INFO:teuthology.orchestra.run.smithi081.stdout:776 write 0xece798c thru 0xecf09d0 (0x9045 bytes) 2024-09-18T00:32:03.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:03.077 INFO:teuthology.orchestra.run.smithi081.stdout:777 write 0x9b21e5 thru 0x9bd3f7 (0xb213 bytes) 2024-09-18T00:32:03.081 INFO:teuthology.orchestra.run.smithi081.stdout:778 trunc from 0xecf09d1 to 0xc992f4c 2024-09-18T00:32:03.095 INFO:teuthology.orchestra.run.smithi081.stdout:779 read 0x52881f9 thru 0x528a4da (0x22e2 bytes) 2024-09-18T00:32:03.095 INFO:teuthology.orchestra.run.smithi081.stdout:780 writesame 0x6cd2fa0 thru 0x6ce16a7 data_size 0x4(0xe708 bytes) 2024-09-18T00:32:03.106 INFO:teuthology.orchestra.run.smithi081.stdout:781 flatten 2024-09-18T00:32:03.113 INFO:teuthology.orchestra.run.smithi081.stdout:782 write 0xb7f94f thru 0xb84073 (0x4725 bytes) 2024-09-18T00:32:03.123 INFO:teuthology.orchestra.run.smithi081.stdout:783 trunc from 0xc992f4c to 0x5d9c256 2024-09-18T00:32:03.133 INFO:teuthology.orchestra.run.smithi081.stdout:784 punch from 0x53ea93 to 0x54dc1f, (0xf18c bytes) 2024-09-18T00:32:03.133 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.133 INFO:teuthology.orchestra.run.smithi081.stdout:787 punch from 0xaff17b to 0xb0c5c2, (0xd447 bytes) 2024-09-18T00:32:03.133 INFO:teuthology.orchestra.run.smithi081.stdout:789 read 0x1a8c0d6 thru 0x1a8d3f2 (0x131d bytes) 2024-09-18T00:32:03.133 INFO:teuthology.orchestra.run.smithi081.stdout:790 write 0x3fe2bb5 thru 0x3feacb7 (0x8103 bytes) 2024-09-18T00:32:03.137 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:03.136+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:03.141 INFO:teuthology.orchestra.run.smithi081.stdout:791 write 0x5fad981 thru 0x5fafe80 (0x2500 bytes) 2024-09-18T00:32:03.156 INFO:teuthology.orchestra.run.smithi081.stdout:792 write 0xd337ba1 thru 0xd33db23 (0x5f83 bytes) 2024-09-18T00:32:03.158 INFO:teuthology.orchestra.run.smithi081.stdout:793 write 0x492f4b4 thru 0x49315c5 (0x2112 bytes) 2024-09-18T00:32:03.159 INFO:teuthology.orchestra.run.smithi081.stdout:795 writesame 0x8d5e719 thru 0x8d5fcea data_size 0x31(0x15d2 bytes) 2024-09-18T00:32:03.161 INFO:teuthology.orchestra.run.smithi081.stdout:797 write 0x6b81874 thru 0x6b8a7aa (0x8f37 bytes) 2024-09-18T00:32:03.162 INFO:teuthology.orchestra.run.smithi081.stdout:798 punch from 0xc6eb510 to 0xc6f7653, (0xc143 bytes) 2024-09-18T00:32:03.162 INFO:teuthology.orchestra.run.smithi081.stdout:799 writesame 0x1b439eb thru 0x1b4ca1e data_size 0xb(0x9034 bytes) 2024-09-18T00:32:03.165 INFO:teuthology.orchestra.run.smithi081.stdout:801 read 0x273297b thru 0x2732dde (0x464 bytes) 2024-09-18T00:32:03.171 INFO:teuthology.orchestra.run.smithi081.stdout:802 trunc from 0xd33db24 to 0x93663b7 2024-09-18T00:32:03.178 INFO:teuthology.orchestra.run.smithi081.stdout:803 punch from 0x8193116 to 0x819daf5, (0xa9df bytes) 2024-09-18T00:32:03.178 INFO:teuthology.orchestra.run.smithi081.stdout:804 write 0x33bf1f0 thru 0x33c0bed (0x19fe bytes) 2024-09-18T00:32:03.179 INFO:teuthology.orchestra.run.smithi081.stdout:805 write 0x7591750 thru 0x759c8ac (0xb15d bytes) 2024-09-18T00:32:03.186 INFO:teuthology.orchestra.run.smithi081.stdout:806 write 0x9b55e98 thru 0x9b5eda0 (0x8f09 bytes) 2024-09-18T00:32:03.187 INFO:teuthology.orchestra.run.smithi081.stdout:807 punch from 0x9ab0d55 to 0x9abb4ed, (0xa798 bytes) 2024-09-18T00:32:03.187 INFO:teuthology.orchestra.run.smithi081.stdout:808 writesame 0x4f46ff3 thru 0x4f4f97f data_size 0x1(0x898d bytes) 2024-09-18T00:32:03.220 INFO:teuthology.orchestra.run.smithi081.stdout:809 write 0xcd80724 thru 0xcd81f88 (0x1865 bytes) 2024-09-18T00:32:03.221 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.221 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1631 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 675840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.872709051999999, 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047626628999999997, 2024-09-18T00:32:03.228 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1631 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:03.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353197+0000", 2024-09-18T00:32:03.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:03.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353198+0000", 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2449999999999999e-06 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353201+0000", 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.399e-06 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353205+0000", 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5760000000000002e-06 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400685+0000", 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047480517999999999 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400769+0000", 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3473000000000005e-05 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400823+0000", 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4137e-05 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.234 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1632 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.872696988, 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047756706000000003, 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1632 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353209+0000", 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353210+0000", 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.514e-06 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353216+0000", 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3920000000000002e-06 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353219+0000", 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.315e-06 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400849+0000", 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047630231000000002 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400901+0000", 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1428999999999998e-05 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400965+0000", 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4543999999999997e-05 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1633 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:03.239 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.872682466000001, 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868945000000003, 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1633 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:03.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354886+0000", 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001662979 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354890+0000", 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354899+0000", 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3510000000000008e-06 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354906+0000", 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5869999999999998e-06 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400994+0000", 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046087545000000001 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401038+0000", 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4535e-05 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401092+0000", 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3687999999999998e-05 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1682 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 47104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.870797268, 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047536968999999998, 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.244 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1682 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0100000000000001e-07 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355109+0000", 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8899999999999998e-07 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355112+0000", 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8770000000000002e-06 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355115+0000", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4030000000000001e-06 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402556+0000", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047441715000000002 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402596+0000", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9635000000000003e-05 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402645+0000", 2024-09-18T00:32:03.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9149e-05 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1683 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.870787808999999, 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047646796999999998, 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.248 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1683 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356882+0000", 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001764334 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356890+0000", 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4759999999999998e-06 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356901+0000", 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0533999999999999e-05 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356912+0000", 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1239e-05 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402670+0000", 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045757985000000001 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402713+0000", 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3121000000000003e-05 2024-09-18T00:32:03.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402764+0000", 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1107999999999999e-05 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1705 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 706560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.866846124, 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047596718000000003, 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.252 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1705 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360881+0000", 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001821802 2024-09-18T00:32:03.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360885+0000", 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4809999999999998e-06 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360892+0000", 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360896+0000", 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6140000000000002e-06 2024-09-18T00:32:03.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406437+0000", 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045540046000000001 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406544+0000", 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107112 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406656+0000", 2024-09-18T00:32:03.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011232500000000001 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1715 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 993280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.864848082, 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047689281, 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.257 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1715 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:03.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361058+0000", 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361059+0000", 2024-09-18T00:32:03.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.697e-06 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361065+0000", 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.507e-06 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361069+0000", 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.442e-06 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408546+0000", 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047476566999999997 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408638+0000", 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2218000000000004e-05 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408747+0000", 2024-09-18T00:32:03.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108528 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1716 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 1021952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.864830461, 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047884890999999999, 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.262 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1716 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361077+0000", 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.823e-06 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361085+0000", 2024-09-18T00:32:03.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5889999999999997e-06 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361089+0000", 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.651e-06 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408783+0000", 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047693194000000001 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408861+0000", 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8220000000000007e-05 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408960+0000", 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9049999999999995e-05 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1754 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 20480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:03.266 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.864810472, 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048097325000000003, 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1754 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361097+0000", 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.714e-06 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361104+0000", 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8580000000000002e-06 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361117+0000", 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3118e-05 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408998+0000", 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047881263 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409088+0000", 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9918000000000002e-05 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409192+0000", 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104079 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.270 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1755 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.864781653, 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048258826999999997, 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.271 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1755 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.32e-07 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361126+0000", 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1059999999999998e-06 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361132+0000", 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0299999999999999e-06 2024-09-18T00:32:03.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361137+0000", 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409215+0000", 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048078567000000003 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409294+0000", 2024-09-18T00:32:03.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8467999999999995e-05 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409383+0000", 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8840999999999999e-05 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1756 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 77824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.864762992999999, 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048360829000000001, 2024-09-18T00:32:03.275 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1756 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361143+0000", 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361154+0000", 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1336e-05 2024-09-18T00:32:03.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361161+0000", 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2629999999999997e-06 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361171+0000", 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3049999999999998e-06 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409408+0000", 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048237447000000003 2024-09-18T00:32:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409451+0000", 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3284000000000001e-05 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409503+0000", 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1833000000000003e-05 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1757 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.864727563000001, 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048438623, 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1757 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362883+0000", 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017047620000000001 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362887+0000", 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1690000000000002e-06 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362897+0000", 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0362e-05 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362905+0000", 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6369999999999999e-06 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409527+0000", 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046622334000000001 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409566+0000", 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9427e-05 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409616+0000", 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9932000000000002e-05 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1764 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 307200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.862826845000001, 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047564585999999999, 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.284 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1764 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363081+0000", 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.869e-06 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363087+0000", 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.387e-06 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363092+0000", 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410478+0000", 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047385746999999999 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410535+0000", 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7154999999999997e-05 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410643+0000", 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108311 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1765 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.288 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.862806916, 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047660415999999997, 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1765 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:03.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363099+0000", 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363102+0000", 2024-09-18T00:32:03.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.898e-06 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363108+0000", 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363118+0000", 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9969999999999993e-06 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410660+0000", 2024-09-18T00:32:03.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047542415999999997 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410703+0000", 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2231000000000003e-05 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410759+0000", 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6271999999999999e-05 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1766 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 364544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.862782193999999, 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868621, 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1766 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363124+0000", 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:03.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363125+0000", 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.48e-06 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363129+0000", 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7579999999999998e-06 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363131+0000", 2024-09-18T00:32:03.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5320000000000001e-06 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410797+0000", 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047665893000000001 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410892+0000", 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4406000000000004e-05 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410992+0000", 2024-09-18T00:32:03.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100191 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1767 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 393216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.862770865, 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047993455999999997, 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1767 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363135+0000", 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0599999999999999e-07 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363139+0000", 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5249999999999999e-06 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363143+0000", 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3550000000000001e-06 2024-09-18T00:32:03.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363145+0000", 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411022+0000", 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047877292000000002 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411073+0000", 2024-09-18T00:32:03.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0528999999999997e-05 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411128+0000", 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4923000000000003e-05 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1768 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.862756878999999, 2024-09-18T00:32:03.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048176798, 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1768 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364882+0000", 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733917 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364892+0000", 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.577e-06 2024-09-18T00:32:03.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364911+0000", 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8868999999999998e-05 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364917+0000", 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8640000000000001e-06 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411156+0000", 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046238915999999998 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411220+0000", 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4751000000000004e-05 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411325+0000", 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104904 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.305 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1775 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 622592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.860863257, 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047673465999999998, 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1775 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.306 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365044+0000", 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1200000000000001e-06 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365047+0000", 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.269e-06 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365049+0000", 2024-09-18T00:32:03.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5720000000000001e-06 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412581+0000", 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047531363 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412636+0000", 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4969999999999997e-05 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412716+0000", 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9861e-05 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1776 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:03.310 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.860852875999999, 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047805461, 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1776 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:03.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365053+0000", 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365054+0000", 2024-09-18T00:32:03.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0189999999999999e-06 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365057+0000", 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0299999999999998e-06 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365059+0000", 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4619999999999999e-06 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412745+0000", 2024-09-18T00:32:03.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047685412000000003 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412795+0000", 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9904000000000002e-05 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412858+0000", 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3406999999999998e-05 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1777 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 10.860843206, 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047940417999999999, 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1777 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:03.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366880+0000", 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018183279999999999 2024-09-18T00:32:03.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366884+0000", 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.002e-06 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366896+0000", 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1119e-05 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366905+0000", 2024-09-18T00:32:03.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4930000000000004e-06 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412893+0000", 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045988345999999999 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412947+0000", 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413003+0000", 2024-09-18T00:32:03.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5770999999999998e-05 2024-09-18T00:32:03.319 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.319 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.319 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.319 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:03.319 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:03.319 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:03.321 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:03.318+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:03.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:03.323 INFO:teuthology.orchestra.run.smithi081.stdout:815 trunc from 0xcd81f89 to 0x17312b7 2024-09-18T00:32:03.323 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.323 INFO:teuthology.orchestra.run.smithi081.stdout:820 write 0x3c7f81e thru 0x3c851c1 (0x59a4 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:822 write 0xdcc1efb thru 0xdcc5001 (0x3107 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:823 writesame 0xa4c598a thru 0xa4c7c89 data_size 0x40(0x2300 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:824 write 0xbdf6787 thru 0xbdfe816 (0x8090 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:827 read 0x67fb386 thru 0x68089c6 (0xd641 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:828 read 0x714ad06 thru 0x714fc8d (0x4f88 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:830 write 0xc164994 thru 0xc17035c (0xb9c9 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:831 punch from 0x221c45d to 0x22251d7, (0x8d7a bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:832 punch from 0xdab5290 to 0xdab8739, (0x34a9 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:833 read 0x5473447 thru 0x5482b67 (0xf721 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:834 trunc from 0xdcc5002 to 0x8223ed2 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:836 read 0x7a98326 thru 0x7aa6247 (0xdf22 bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:838 writesame 0x9adcb7b thru 0x9ae9504 data_size 0x3(0xc98a bytes) 2024-09-18T00:32:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:839 write 0x33a2e51 thru 0x33adb24 (0xacd4 bytes) 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:840 writesame 0x12b7b2c thru 0x12beb03 data_size 0xc(0x6fd8 bytes) 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:841 trunc from 0x9ae9505 to 0xc800d07 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:842 punch from 0xb067286 to 0xb06b9f4, (0x476e bytes) 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:845 read 0x1160947 thru 0x1161009 (0x6c3 bytes) 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:846 read 0x81e1df8 thru 0x81e6eaa (0x50b3 bytes) 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:851 write 0xd345661 thru 0xd352c84 (0xd624 bytes) 2024-09-18T00:32:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:852 write 0x34da8a3 thru 0x34dde9a (0x35f8 bytes) 2024-09-18T00:32:03.326 INFO:teuthology.orchestra.run.smithi081.stdout:853 read 0x7b107bf thru 0x7b17e17 (0x7659 bytes) 2024-09-18T00:32:03.326 INFO:teuthology.orchestra.run.smithi081.stdout:855 write 0xd12f3bd thru 0xd13e33d (0xef81 bytes) 2024-09-18T00:32:03.326 INFO:teuthology.orchestra.run.smithi081.stdout:856 writesame 0xbd33783 thru 0xbd3faab data_size 0x1(0xc329 bytes) 2024-09-18T00:32:03.358 INFO:teuthology.orchestra.run.smithi081.stdout:857 writesame 0x6e96f08 thru 0x6ea33c4 data_size 0x7(0xc4bd bytes) 2024-09-18T00:32:03.364 INFO:teuthology.orchestra.run.smithi081.stdout:858 write 0xabdbfa2 thru 0xabe205c (0x60bb bytes) 2024-09-18T00:32:03.366 INFO:teuthology.orchestra.run.smithi081.stdout:859 read 0x292fb80 thru 0x293d40d (0xd88e bytes) 2024-09-18T00:32:03.366 INFO:teuthology.orchestra.run.smithi081.stdout:860 write 0x65c271 thru 0x66bf18 (0xfca8 bytes) 2024-09-18T00:32:03.375 INFO:teuthology.orchestra.run.smithi081.stdout:861 trunc from 0xd352c85 to 0x848ddeb 2024-09-18T00:32:03.387 INFO:teuthology.orchestra.run.smithi081.stdout:862 punch from 0x40e05f3 to 0x40e35d9, (0x2fe6 bytes) 2024-09-18T00:32:03.387 INFO:teuthology.orchestra.run.smithi081.stdout:863 read 0x5f88244 thru 0x5f8c950 (0x470d bytes) 2024-09-18T00:32:03.398 INFO:teuthology.orchestra.run.smithi081.stdout:864 write 0xcf102c1 thru 0xcf1cba6 (0xc8e6 bytes) 2024-09-18T00:32:03.400 INFO:teuthology.orchestra.run.smithi081.stdout:865 write 0x21c809a thru 0x21c89a1 (0x908 bytes) 2024-09-18T00:32:03.401 INFO:teuthology.orchestra.run.smithi081.stdout:866 writesame 0x943b2e6 thru 0x9449f5c data_size 0x1(0xec77 bytes) 2024-09-18T00:32:03.420 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:03.419+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:03.433 INFO:teuthology.orchestra.run.smithi081.stdout:868 writesame 0x5cdb7a7 thru 0x5ce4419 data_size 0x55(0x8c73 bytes) 2024-09-18T00:32:03.436 INFO:teuthology.orchestra.run.smithi081.stdout:869 read 0x7671244 thru 0x7680d49 (0xfb06 bytes) 2024-09-18T00:32:03.437 INFO:teuthology.orchestra.run.smithi081.stdout:870 trunc from 0xcf1cba7 to 0xc943836 2024-09-18T00:32:03.438 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:03.439 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:03.439 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:03.439 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:03.448 INFO:teuthology.orchestra.run.smithi081.stdout:873 writesame 0x67f8f64 thru 0x6803cc9 data_size 0x73(0xad66 bytes) 2024-09-18T00:32:03.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:874 writesame 0xcff0b22 thru 0xcfff5bc data_size 0x1(0xea9b bytes) 2024-09-18T00:32:03.468 INFO:teuthology.orchestra.run.smithi081.stdout:875 trunc from 0xcfff5bd to 0x4c41a4c 2024-09-18T00:32:03.492 INFO:teuthology.orchestra.run.smithi081.stdout:876 write 0xe04b4dc thru 0xe05a43f (0xef64 bytes) 2024-09-18T00:32:03.495 INFO:teuthology.orchestra.run.smithi081.stdout:880 write 0x21a88c8 thru 0x21b4918 (0xc051 bytes) 2024-09-18T00:32:03.497 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.497 INFO:teuthology.orchestra.run.smithi081.stdout:882 punch from 0x3199ed4 to 0x31a90d7, (0xf203 bytes) 2024-09-18T00:32:03.497 INFO:teuthology.orchestra.run.smithi081.stdout:883 read 0x4051b81 thru 0x405ac2c (0x90ac bytes) 2024-09-18T00:32:03.497 INFO:teuthology.orchestra.run.smithi081.stdout:884 write 0x9ef1450 thru 0x9efcb0e (0xb6bf bytes) 2024-09-18T00:32:03.499 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.499 INFO:teuthology.orchestra.run.smithi081.stdout:888 write 0x5773358 thru 0x5783252 (0xfefb bytes) 2024-09-18T00:32:03.500 INFO:teuthology.orchestra.run.smithi081.stdout:889 read 0x9e02d7b thru 0x9e11496 (0xe71c bytes) 2024-09-18T00:32:03.500 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.500 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xe9456fa 2024-09-18T00:32:03.501 INFO:teuthology.orchestra.run.smithi081.stdout:891 trunc from 0xe05a440 to 0xe9456fa 2024-09-18T00:32:03.506 INFO:teuthology.orchestra.run.smithi081.stdout:892 write 0xc4354a6 thru 0xc4396d9 (0x4234 bytes) 2024-09-18T00:32:03.508 INFO:teuthology.orchestra.run.smithi081.stdout:894 write 0x7306167 thru 0x73157ea (0xf684 bytes) 2024-09-18T00:32:03.509 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.509 INFO:teuthology.orchestra.run.smithi081.stdout:896 read 0x6ab4e25 thru 0x6ac0e0e (0xbfea bytes) 2024-09-18T00:32:03.510 INFO:teuthology.orchestra.run.smithi081.stdout:897 punch from 0x8791a8 to 0x888d29, (0xfb81 bytes) 2024-09-18T00:32:03.510 INFO:teuthology.orchestra.run.smithi081.stdout:898 write 0x97fa563 thru 0x9807048 (0xcae6 bytes) 2024-09-18T00:32:03.512 INFO:teuthology.orchestra.run.smithi081.stdout:899 writesame 0xde9e6e thru 0xdf8b5a data_size 0x1(0xeced bytes) 2024-09-18T00:32:03.521 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:03.519+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:03.543 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:03.543 INFO:teuthology.orchestra.run.smithi081.stdout:902 clone 9 order 23 su 1048576 sc 14 2024-09-18T00:32:03.568 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:03.568 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:03.568 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:03.568 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:03.568 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:03.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:03.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:03.621 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:03.620+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:03.722 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:03.721+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:03.727 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:03.727 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:03.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:03.727 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:03.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.727 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5129 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7604404549999995, 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028611574000000001, 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5129 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964567+0000", 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0899999999999997e-07 2024-09-18T00:32:03.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964568+0000", 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8050000000000001e-06 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964577+0000", 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3149999999999992e-06 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964581+0000", 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4789999999999998e-06 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993004+0000", 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028422612 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993083+0000", 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9367000000000001e-05 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993178+0000", 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4686999999999997e-05 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5130 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7604201269999997, 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029079462, 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5130 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0100000000000001e-07 2024-09-18T00:32:03.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964593+0000", 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0809999999999999e-06 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964599+0000", 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9660000000000001e-06 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964603+0000", 2024-09-18T00:32:03.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3340000000000003e-06 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993209+0000", 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028605815 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993577+0000", 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036788599999999999 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993666+0000", 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9079000000000006e-05 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5168 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 26624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7603979699999996, 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02923388, 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5168 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964611+0000", 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6390000000000001e-06 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964616+0000", 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1880000000000001e-06 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964620+0000", 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993694+0000", 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029073485 2024-09-18T00:32:03.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993763+0000", 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9064000000000001e-05 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993843+0000", 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9919999999999994e-05 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5169 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7603814460000002, 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029406055, 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5169 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.742 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964626+0000", 2024-09-18T00:32:03.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964627+0000", 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6649999999999999e-06 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964633+0000", 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964637+0000", 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.189e-06 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993870+0000", 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029233424000000001 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993951+0000", 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1051999999999996e-05 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994031+0000", 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0019999999999996e-05 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5170 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 83968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7603650510000008, 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029576037999999999, 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5170 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964644+0000", 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5540000000000001e-06 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964650+0000", 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0950000000000001e-06 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964654+0000", 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3250000000000001e-06 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994058+0000", 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029403655000000001 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994133+0000", 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4974000000000004e-05 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994218+0000", 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5144999999999999e-05 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5171 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7603455990000008, 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030497487, 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5171 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964662+0000", 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964663+0000", 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.722e-06 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964672+0000", 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7320000000000004e-06 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964677+0000", 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.527e-06 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994247+0000", 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029570603000000001 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995061+0000", 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00081419399999999996 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995159+0000", 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7380999999999995e-05 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5172 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7603248370000006, 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030717230000000002, 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5172 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964691+0000", 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6149999999999997e-06 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964697+0000", 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964705+0000", 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0320000000000003e-06 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995209+0000", 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030504452000000001 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995301+0000", 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1367999999999997e-05 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995399+0000", 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8340999999999999e-05 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5173 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:03.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7602959830000007, 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030867024, 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5173 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:03.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0500000000000004e-07 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964713+0000", 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.84e-06 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964719+0000", 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4600000000000002e-06 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964723+0000", 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995429+0000", 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030706563999999999 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995500+0000", 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0500999999999995e-05 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995578+0000", 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8035999999999996e-05 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5174 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7602791389999997, 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031034297999999998, 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5174 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:03.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964730+0000", 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.655e-06 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964735+0000", 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3940000000000004e-06 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964744+0000", 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995603+0000", 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030859780999999999 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995676+0000", 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2704000000000001e-05 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995762+0000", 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5841999999999996e-05 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5175 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7602575980000008, 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031208080999999999, 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5175 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964750+0000", 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:32:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964751+0000", 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.829e-06 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964757+0000", 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3789999999999997e-06 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964761+0000", 2024-09-18T00:32:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1520000000000002e-06 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995789+0000", 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031028525000000001 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995862+0000", 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2515999999999995e-05 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995957+0000", 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5340000000000005e-05 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5176 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 256000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7602406090000002, 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031341039000000001, 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5176 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964767+0000", 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964768+0000", 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6610000000000001e-06 2024-09-18T00:32:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964774+0000", 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3850000000000001e-06 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964778+0000", 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995985+0000", 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031206289000000002 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996058+0000", 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2974999999999998e-05 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996107+0000", 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9639999999999999e-05 2024-09-18T00:32:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5177 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 284672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7602234410000008, 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031522255999999998, 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5177 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964784+0000", 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9200000000000002e-07 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964785+0000", 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6869999999999999e-06 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964797+0000", 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1282e-05 2024-09-18T00:32:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964801+0000", 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5510000000000001e-06 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996136+0000", 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031334870000000001 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996211+0000", 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4475999999999996e-05 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996306+0000", 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5098000000000003e-05 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5178 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 313344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7602000140000005, 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031735948, 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5178 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964809+0000", 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7630000000000001e-06 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964819+0000", 2024-09-18T00:32:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0224000000000001e-05 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964824+0000", 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4139999999999996e-06 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996356+0000", 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031532646999999997 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996446+0000", 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9993000000000004e-05 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996543+0000", 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6576000000000005e-05 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5179 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7601771759999991, 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031953505, 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5179 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964837+0000", 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964843+0000", 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.336e-06 2024-09-18T00:32:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964848+0000", 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4440000000000001e-06 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996593+0000", 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031745821 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996680+0000", 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6953000000000006e-05 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996783+0000", 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010280000000000001 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5180 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 370688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7601528609999999, 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032134442999999999, 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5180 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964856+0000", 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964862+0000", 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.519e-06 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964866+0000", 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:03.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996812+0000", 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031946039000000002 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996899+0000", 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7064999999999994e-05 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996988+0000", 2024-09-18T00:32:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9370999999999995e-05 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5181 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 399360~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.760131221, 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.03234393, 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5181 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964878+0000", 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.844e-06 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964883+0000", 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1100000000000002e-06 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964887+0000", 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9169999999999999e-06 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997032+0000", 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032145646 2024-09-18T00:32:03.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997116+0000", 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3858999999999998e-05 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997220+0000", 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010323399999999999 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5182 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7601151660000003, 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032589419000000001, 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5182 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.802 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964894+0000", 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6700000000000001e-06 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964899+0000", 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1080000000000001e-06 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964903+0000", 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8210000000000003e-06 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997297+0000", 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032394065 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997380+0000", 2024-09-18T00:32:03.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3226000000000006e-05 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997481+0000", 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101048 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5183 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7600926539999993, 2024-09-18T00:32:03.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032807066000000003, 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5183 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964921+0000", 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:03.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964926+0000", 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964934+0000", 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6809999999999998e-06 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997526+0000", 2024-09-18T00:32:03.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032591805000000001 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997617+0000", 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1439000000000003e-05 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997721+0000", 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0001039 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5184 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7600668640000006, 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033026119, 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5184 2024-09-18T00:32:03.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964942+0000", 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.846e-06 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964948+0000", 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5489999999999997e-06 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964952+0000", 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1060000000000002e-06 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997766+0000", 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032814589999999998 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997863+0000", 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6146999999999999e-05 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997966+0000", 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103454 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5185 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 514048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7600502079999991, 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033245331000000003, 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5185 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9400000000000001e-07 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964958+0000", 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6160000000000001e-06 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964969+0000", 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964974+0000", 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2180000000000001e-06 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998013+0000", 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033038901000000002 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998112+0000", 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9028000000000001e-05 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998202+0000", 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0288e-05 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:03.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:03.821 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:03.826 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:03.824+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:03.840 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:03.840 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:03.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:03.927 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:03.925+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:03.927 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:32:03.932 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:03.932 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:03.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:04.027 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:04.026+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:04.092 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.093 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:04.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:04.144 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:04.142+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-18T00:32:04.230 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:04.228+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:04.257 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.257 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:04.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:04.327 INFO:teuthology.orchestra.run.smithi081.stdout:903 write 0xdb72c85 thru 0xdb7795b (0x4cd7 bytes) 2024-09-18T00:32:04.330 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:04.329+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:04.335 INFO:teuthology.orchestra.run.smithi081.stdout:904 writesame 0xc994507 thru 0xc99bca4 data_size 0x2(0x779e bytes) 2024-09-18T00:32:04.346 INFO:teuthology.orchestra.run.smithi081.stdout:905 write 0x6d4ed06 thru 0x6d593c3 (0xa6be bytes) 2024-09-18T00:32:04.352 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.352 INFO:teuthology.orchestra.run.smithi081.stdout:907 read 0xb234e25 thru 0xb2423da (0xd5b6 bytes) 2024-09-18T00:32:04.353 INFO:teuthology.orchestra.run.smithi081.stdout:908 write 0x4a20fab thru 0x4a2a1a2 (0x91f8 bytes) 2024-09-18T00:32:04.360 INFO:teuthology.orchestra.run.smithi081.stdout:911 read 0xd53aee4 thru 0xd549d32 (0xee4f bytes) 2024-09-18T00:32:04.360 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.360 INFO:teuthology.orchestra.run.smithi081.stdout:913 write 0xc223358 thru 0xc22df6e (0xac17 bytes) 2024-09-18T00:32:04.375 INFO:teuthology.orchestra.run.smithi081.stdout:914 trunc from 0xe9456fa to 0x5982606 2024-09-18T00:32:04.411 INFO:teuthology.orchestra.run.smithi081.stdout:915 writesame 0xb7ed01b thru 0xb7f20d8 data_size 0x6a(0x50be bytes) 2024-09-18T00:32:04.411 INFO:teuthology.orchestra.run.smithi081.stdout:916 write 0x19b9373 thru 0x19c45d2 (0xb260 bytes) 2024-09-18T00:32:04.412 INFO:teuthology.orchestra.run.smithi081.stdout:918 read 0x6dbcfee thru 0x6dc915a (0xc16d bytes) 2024-09-18T00:32:04.413 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.413 INFO:teuthology.orchestra.run.smithi081.stdout:923 read 0x3fb94b thru 0x3fbd03 (0x3b9 bytes) 2024-09-18T00:32:04.413 INFO:teuthology.orchestra.run.smithi081.stdout:925 read 0x2279de1 thru 0x227b040 (0x1260 bytes) 2024-09-18T00:32:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:926 read 0xacc5ba9 thru 0xacd0a2b (0xae83 bytes) 2024-09-18T00:32:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:927 read 0xb1db193 thru 0xb1e7521 (0xc38f bytes) 2024-09-18T00:32:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:928 read 0x8ee0406 thru 0x8ee894e (0x8549 bytes) 2024-09-18T00:32:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:929 write 0x8cce98d thru 0x8cd676f (0x7de3 bytes) 2024-09-18T00:32:04.417 INFO:teuthology.orchestra.run.smithi081.stdout:930 write 0x9c3a289 thru 0x9c41452 (0x71ca bytes) 2024-09-18T00:32:04.420 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.420 INFO:teuthology.orchestra.run.smithi081.stdout:934 read 0x1a541f7 thru 0x1a5a5ec (0x63f6 bytes) 2024-09-18T00:32:04.420 INFO:teuthology.orchestra.run.smithi081.stdout:935 read 0x361f52 thru 0x36f165 (0xd214 bytes) 2024-09-18T00:32:04.421 INFO:teuthology.orchestra.run.smithi081.stdout:936 write 0x586d4fb thru 0x5878328 (0xae2e bytes) 2024-09-18T00:32:04.422 INFO:teuthology.orchestra.run.smithi081.stdout:937 punch from 0x71d38a4 to 0x71dc673, (0x8dcf bytes) 2024-09-18T00:32:04.423 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.423 INFO:teuthology.orchestra.run.smithi081.stdout:940 writesame 0x507f77c thru 0x5084857 data_size 0x64(0x50dc bytes) 2024-09-18T00:32:04.424 INFO:teuthology.orchestra.run.smithi081.stdout:942 write 0x9e0abbd thru 0x9e12c02 (0x8046 bytes) 2024-09-18T00:32:04.424 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.424 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:04.427 INFO:teuthology.orchestra.run.smithi081.stdout:943 punch from 0x6644891 to 0x66448fd, (0x6c bytes) 2024-09-18T00:32:04.427 INFO:teuthology.orchestra.run.smithi081.stdout:944 write 0x10e99f2 thru 0x10f6a73 (0xd082 bytes) 2024-09-18T00:32:04.429 INFO:teuthology.orchestra.run.smithi081.stdout:945 write 0x2e4aafc thru 0x2e4ca20 (0x1f25 bytes) 2024-09-18T00:32:04.430 INFO:teuthology.orchestra.run.smithi081.stdout:946 write 0x9352bb8 thru 0x935528d (0x26d6 bytes) 2024-09-18T00:32:04.431 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:04.429+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:04.433 INFO:teuthology.orchestra.run.smithi081.stdout:947 punch from 0x10aa6f9 to 0x10ac29e, (0x1ba5 bytes) 2024-09-18T00:32:04.433 INFO:teuthology.orchestra.run.smithi081.stdout:948 writesame 0x59fd19f thru 0x5a01f0c data_size 0x35(0x4d6e bytes) 2024-09-18T00:32:04.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:04.435 INFO:teuthology.orchestra.run.smithi081.stdout:950 read 0x143b018 thru 0x143d610 (0x25f9 bytes) 2024-09-18T00:32:04.435 INFO:teuthology.orchestra.run.smithi081.stdout:953 read 0x9648362 thru 0x965225d (0x9efc bytes) 2024-09-18T00:32:04.435 INFO:teuthology.orchestra.run.smithi081.stdout:954 read 0x206a5a1 thru 0x206aefa (0x95a bytes) 2024-09-18T00:32:04.435 INFO:teuthology.orchestra.run.smithi081.stdout:956 writesame 0x61aafed thru 0x61abcca data_size 0x1b(0xcde bytes) 2024-09-18T00:32:04.437 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.437 INFO:teuthology.orchestra.run.smithi081.stdout:958 writesame 0xb6dbaf8 thru 0xb6de6d8 data_size 0x1(0x2be1 bytes) 2024-09-18T00:32:04.444 INFO:teuthology.orchestra.run.smithi081.stdout:959 punch from 0xae8b41c to 0xae8ec62, (0x3846 bytes) 2024-09-18T00:32:04.444 INFO:teuthology.orchestra.run.smithi081.stdout:960 write 0x19b05e8 thru 0x19b3c3b (0x3654 bytes) 2024-09-18T00:32:04.445 INFO:teuthology.orchestra.run.smithi081.stdout:961 punch from 0x6d87098 to 0x6d8a1ee, (0x3156 bytes) 2024-09-18T00:32:04.453 INFO:teuthology.orchestra.run.smithi081.stdout:962 trunc from 0xb7f20d9 to 0x52e1c50 2024-09-18T00:32:04.532 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:04.530+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:04.540 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.540 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:04.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:04.632 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:04.631+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:963 punch from 0x300ab19 to 0x3013c06, (0x90ed bytes) 2024-09-18T00:32:04.672 INFO:teuthology.orchestra.run.smithi081.stdout:964 writesame 0x533b2ef thru 0x5346fdb data_size 0x11(0xbced bytes) 2024-09-18T00:32:04.673 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.673 INFO:teuthology.orchestra.run.smithi081.stdout:966 read 0x117e869 thru 0x1189edd (0xb675 bytes) 2024-09-18T00:32:04.679 INFO:teuthology.orchestra.run.smithi081.stdout:967 writesame 0x5fdf7b0 thru 0x5fe278d data_size 0xb(0x2fde bytes) 2024-09-18T00:32:04.680 INFO:teuthology.orchestra.run.smithi081.stdout:968 write 0x1424209 thru 0x1428a49 (0x4841 bytes) 2024-09-18T00:32:04.696 INFO:teuthology.orchestra.run.smithi081.stdout:969 write 0xd24f065 thru 0xd25741f (0x83bb bytes) 2024-09-18T00:32:04.697 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.697 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:04.704 INFO:teuthology.orchestra.run.smithi081.stdout:970 trunc from 0xd257420 to 0x89c87de 2024-09-18T00:32:04.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:04.710 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.715 INFO:teuthology.orchestra.run.smithi081.stdout:972 trunc from 0x89c87de to 0x4c1bb9e 2024-09-18T00:32:04.727 INFO:teuthology.orchestra.run.smithi081.stdout:973 punch from 0x45b17c2 to 0x45c1390, (0xfbce bytes) 2024-09-18T00:32:04.727 INFO:teuthology.orchestra.run.smithi081.stdout:974 punch from 0x180b6e to 0x185db3, (0x5245 bytes) 2024-09-18T00:32:04.727 INFO:teuthology.orchestra.run.smithi081.stdout:975 read 0x10b6872 thru 0x10c362b (0xcdba bytes) 2024-09-18T00:32:04.728 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.728 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.728 INFO:teuthology.orchestra.run.smithi081.stdout:978 read 0x3b6539c thru 0x3b66183 (0xde8 bytes) 2024-09-18T00:32:04.728 INFO:teuthology.orchestra.run.smithi081.stdout:980 read 0x43aabdc thru 0x43adde4 (0x3209 bytes) 2024-09-18T00:32:04.733 INFO:teuthology.orchestra.run.smithi081.stdout:981 write 0x516867f thru 0x516e8a5 (0x6227 bytes) 2024-09-18T00:32:04.733 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:04.732+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:04.737 INFO:teuthology.orchestra.run.smithi081.stdout:983 trunc from 0x516e8a6 to 0x288c8a6 2024-09-18T00:32:04.758 INFO:teuthology.orchestra.run.smithi081.stdout:985 writesame 0x85bd41e thru 0x85c15fa data_size 0x1(0x41dd bytes) 2024-09-18T00:32:04.758 INFO:teuthology.orchestra.run.smithi081.stdout:989 writesame 0x66634fe thru 0x6673021 data_size 0x2(0xfb24 bytes) 2024-09-18T00:32:04.779 INFO:teuthology.orchestra.run.smithi081.stdout:990 read 0x451d277 thru 0x4525d4f (0x8ad9 bytes) 2024-09-18T00:32:04.780 INFO:teuthology.orchestra.run.smithi081.stdout:991 read 0x449d39d thru 0x44a22d1 (0x4f35 bytes) 2024-09-18T00:32:04.781 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.781 INFO:teuthology.orchestra.run.smithi081.stdout:994 read 0x69fe5af thru 0x6a05fcd (0x7a1f bytes) 2024-09-18T00:32:04.781 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.781 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.782 INFO:teuthology.orchestra.run.smithi081.stdout:997 write 0x5d4721d thru 0x5d4c6b9 (0x549d bytes) 2024-09-18T00:32:04.792 INFO:teuthology.orchestra.run.smithi081.stdout:998 write 0xbea7c61 thru 0xbeb26c7 (0xaa67 bytes) 2024-09-18T00:32:04.796 INFO:teuthology.orchestra.run.smithi081.stdout:999 read 0xb90c095 thru 0xb916f35 (0xaea1 bytes) 2024-09-18T00:32:04.796 INFO:teuthology.orchestra.run.smithi081.stdout:1000 read 0x8ec50dd thru 0x8ecb398 (0x62bc bytes) 2024-09-18T00:32:04.796 INFO:teuthology.orchestra.run.smithi081.stdout:1002 read 0xa1cf5c7 thru 0xa1d8952 (0x938c bytes) 2024-09-18T00:32:04.802 INFO:teuthology.orchestra.run.smithi081.stdout:1005 write 0xcb399c0 thru 0xcb466e8 (0xcd29 bytes) 2024-09-18T00:32:04.805 INFO:teuthology.orchestra.run.smithi081.stdout:1006 punch from 0x27c71cd to 0x27c818f, (0xfc2 bytes) 2024-09-18T00:32:04.805 INFO:teuthology.orchestra.run.smithi081.stdout:1008 write 0x4c89de1 thru 0x4c90878 (0x6a98 bytes) 2024-09-18T00:32:04.806 INFO:teuthology.orchestra.run.smithi081.stdout:1009 write 0x6195772 thru 0x61970e7 (0x1976 bytes) 2024-09-18T00:32:04.808 INFO:teuthology.orchestra.run.smithi081.stdout:1011 punch from 0x3001153 to 0x30033c9, (0x2276 bytes) 2024-09-18T00:32:04.809 INFO:teuthology.orchestra.run.smithi081.stdout:1012 read 0x5bd5373 thru 0x5bd914d (0x3ddb bytes) 2024-09-18T00:32:04.809 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.809 INFO:teuthology.orchestra.run.smithi081.stdout:1014 writesame 0x185044c thru 0x185664b data_size 0x40(0x6200 bytes) 2024-09-18T00:32:04.810 INFO:teuthology.orchestra.run.smithi081.stdout:1015 read 0xa2cbd1b thru 0xa2d6cc5 (0xafab bytes) 2024-09-18T00:32:04.817 INFO:teuthology.orchestra.run.smithi081.stdout:1016 writesame 0xdd20b11 thru 0xdd25fdf data_size 0x1(0x54cf bytes) 2024-09-18T00:32:04.817 INFO:teuthology.orchestra.run.smithi081.stdout:1018 write 0x379cecf thru 0x37a618d (0x92bf bytes) 2024-09-18T00:32:04.818 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.819 INFO:teuthology.orchestra.run.smithi081.stdout:1020 write 0x72fc5fa thru 0x7304f89 (0x8990 bytes) 2024-09-18T00:32:04.822 INFO:teuthology.orchestra.run.smithi081.stdout:1022 read 0xbb8120c thru 0xbb83b0d (0x2902 bytes) 2024-09-18T00:32:04.823 INFO:teuthology.orchestra.run.smithi081.stdout:1023 trunc from 0xdd25fe0 to 0xe88be8f 2024-09-18T00:32:04.828 INFO:teuthology.orchestra.run.smithi081.stdout:1024 read 0xadc8331 thru 0xadd1d3b (0x9a0b bytes) 2024-09-18T00:32:04.829 INFO:teuthology.orchestra.run.smithi081.stdout:1025 write 0xc0b7487 thru 0xc0bf6fd (0x8277 bytes) 2024-09-18T00:32:04.832 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.832 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:04.833 INFO:teuthology.orchestra.run.smithi081.stdout:1026 read 0x2525a4d thru 0x252b296 (0x584a bytes) 2024-09-18T00:32:04.833 INFO:teuthology.orchestra.run.smithi081.stdout:1028 read 0x8736b18 thru 0x8739f94 (0x347d bytes) 2024-09-18T00:32:04.833 INFO:teuthology.orchestra.run.smithi081.stdout:1029 punch from 0x6828cb to 0x684a49, (0x217e bytes) 2024-09-18T00:32:04.833 INFO:teuthology.orchestra.run.smithi081.stdout:1030 write 0x6362c10 thru 0x636d46a (0xa85b bytes) 2024-09-18T00:32:04.834 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:04.833+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:04.834 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:04.835 INFO:teuthology.orchestra.run.smithi081.stdout:1032 write 0x21400c4 thru 0x2142994 (0x28d1 bytes) 2024-09-18T00:32:04.836 INFO:teuthology.orchestra.run.smithi081.stdout:1033 read 0x6ba28b4 thru 0x6ba6160 (0x38ad bytes) 2024-09-18T00:32:04.836 INFO:teuthology.orchestra.run.smithi081.stdout:1034 punch from 0x2e94e92 to 0x2ea102e, (0xc19c bytes) 2024-09-18T00:32:04.836 INFO:teuthology.orchestra.run.smithi081.stdout:1036 punch from 0x6f8dfbd to 0x6f9debc, (0xfeff bytes) 2024-09-18T00:32:04.836 INFO:teuthology.orchestra.run.smithi081.stdout:1038 read 0x3e49f76 thru 0x3e4a9df (0xa6a bytes) 2024-09-18T00:32:04.837 INFO:teuthology.orchestra.run.smithi081.stdout:1039 write 0xc9d15cf thru 0xc9dbf31 (0xa963 bytes) 2024-09-18T00:32:04.839 INFO:teuthology.orchestra.run.smithi081.stdout:1040 read 0x6c08931 thru 0x6c134cc (0xab9c bytes) 2024-09-18T00:32:04.840 INFO:teuthology.orchestra.run.smithi081.stdout:1041 write 0xbfd276b thru 0xbfd766f (0x4f05 bytes) 2024-09-18T00:32:04.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:04.843 INFO:teuthology.orchestra.run.smithi081.stdout:1042 clone 10 order 19 su 4096 sc 11 2024-09-18T00:32:04.935 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:04.934+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:04.989 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone9 from 0xe88be8f (overlap 0x288c8a6) to 0x81c1ba 2024-09-18T00:32:04.994 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:04.995 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:05.036 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:05.034+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:05.058 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-18T00:32:05.123 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:05.123 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:05.137 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:05.135+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:05.237 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:05.236+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:05.240 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:05.240 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:05.338 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:05.337+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:05.355 INFO:teuthology.orchestra.run.smithi081.stdout:1043 punch from 0x3fae2d7 to 0x3fae945, (0x66e bytes) 2024-09-18T00:32:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:1045 write 0x26dc203 thru 0x26e1d73 (0x5b71 bytes) 2024-09-18T00:32:05.411 INFO:teuthology.orchestra.run.smithi081.stdout:1046 read 0x93f7c12 thru 0x93fe1ff (0x65ee bytes) 2024-09-18T00:32:05.411 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:05.411 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.412 INFO:teuthology.orchestra.run.smithi081.stdout:1049 writesame 0xd84dca9 thru 0xd852be8 data_size 0x20(0x4f40 bytes) 2024-09-18T00:32:05.424 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:05.439 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:05.437+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:05.444 INFO:teuthology.orchestra.run.smithi081.stdout:1051 read 0xc5f7bc0 thru 0xc5fd7a8 (0x5be9 bytes) 2024-09-18T00:32:05.444 INFO:teuthology.orchestra.run.smithi081.stdout:1052 read 0x1219faa thru 0x1225ffa (0xc051 bytes) 2024-09-18T00:32:05.446 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.446 INFO:teuthology.orchestra.run.smithi081.stdout:1055 writesame 0x124e4b8 thru 0x1254a5f data_size 0x4(0x65a8 bytes) 2024-09-18T00:32:05.501 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.501 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xea6ff67 2024-09-18T00:32:05.501 INFO:teuthology.orchestra.run.smithi081.stdout:1058 trunc from 0xe88be8f to 0xea6ff67 2024-09-18T00:32:05.507 INFO:teuthology.orchestra.run.smithi081.stdout:1059 write 0xdf33200 thru 0xdf422be (0xf0bf bytes) 2024-09-18T00:32:05.540 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:05.539+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:05.543 INFO:teuthology.orchestra.run.smithi081.stdout:1060 write 0xd3a7883 thru 0xd3a8ca9 (0x1427 bytes) 2024-09-18T00:32:05.554 INFO:teuthology.orchestra.run.smithi081.stdout:1062 read 0x804af9c thru 0x804cb8d (0x1bf2 bytes) 2024-09-18T00:32:05.554 INFO:teuthology.orchestra.run.smithi081.stdout:1063 read 0x119bef thru 0x124926 (0xad38 bytes) 2024-09-18T00:32:05.558 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:05.558 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:05.570 INFO:teuthology.orchestra.run.smithi081.stdout:1064 trunc from 0xea6ff67 to 0x34ed69f 2024-09-18T00:32:05.642 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:05.640+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:05.661 INFO:teuthology.orchestra.run.smithi081.stdout:1067 trunc from 0x34ed69f to 0x1699e0 2024-09-18T00:32:05.729 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:05.729 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:05.769 INFO:teuthology.orchestra.run.smithi081.stdout:1068 read 0x13b0ad thru 0x13c420 (0x1374 bytes) 2024-09-18T00:32:05.770 INFO:teuthology.orchestra.run.smithi081.stdout:1071 read 0x1393fe thru 0x13fddd (0x69e0 bytes) 2024-09-18T00:32:05.782 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:05.780+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:05.787 INFO:teuthology.orchestra.run.smithi081.stdout:1072 trunc from 0x1699e0 to 0xea060be 2024-09-18T00:32:05.795 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.795 INFO:teuthology.orchestra.run.smithi081.stdout:1075 write 0x563ca9a thru 0x563f80d (0x2d74 bytes) 2024-09-18T00:32:05.803 INFO:teuthology.orchestra.run.smithi081.stdout:1076 read 0xcf97c2c thru 0xcf993c8 (0x179d bytes) 2024-09-18T00:32:05.804 INFO:teuthology.orchestra.run.smithi081.stdout:1078 read 0x69aa504 thru 0x69acf0f (0x2a0c bytes) 2024-09-18T00:32:05.804 INFO:teuthology.orchestra.run.smithi081.stdout:1079 writesame 0xa8da114 thru 0xa8e1dbe data_size 0xd(0x7cab bytes) 2024-09-18T00:32:05.816 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xecf21f7 2024-09-18T00:32:05.817 INFO:teuthology.orchestra.run.smithi081.stdout:1080 trunc from 0xea060be to 0xecf21f7 2024-09-18T00:32:05.821 INFO:teuthology.orchestra.run.smithi081.stdout:1081 writesame 0x6aa5371 thru 0x6aa8fb6 data_size 0x5(0x3c46 bytes) 2024-09-18T00:32:05.831 INFO:teuthology.orchestra.run.smithi081.stdout:1082 writesame 0x9c3bd36 thru 0x9c43d0a data_size 0x77(0x7fd5 bytes) 2024-09-18T00:32:05.842 INFO:teuthology.orchestra.run.smithi081.stdout:1083 trunc from 0xecf21f7 to 0xcf726fc 2024-09-18T00:32:05.843 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:05.842+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:05.847 INFO:teuthology.orchestra.run.smithi081.stdout:1084 read 0xaf8802f thru 0xaf966e0 (0xe6b2 bytes) 2024-09-18T00:32:05.857 INFO:teuthology.orchestra.run.smithi081.stdout:1085 trunc from 0xcf726fc to 0x51e01db 2024-09-18T00:32:05.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:05.879 INFO:teuthology.orchestra.run.smithi081.stdout:1086 write 0x77eaa8f thru 0x77ecb92 (0x2104 bytes) 2024-09-18T00:32:05.884 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.884 INFO:teuthology.orchestra.run.smithi081.stdout:1088 write 0x6effbdc thru 0x6f0f3fa (0xf81f bytes) 2024-09-18T00:32:05.896 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.896 INFO:teuthology.orchestra.run.smithi081.stdout:1090 read 0x5c7adc9 thru 0x5c84d95 (0x9fcd bytes) 2024-09-18T00:32:05.896 INFO:teuthology.orchestra.run.smithi081.stdout:1091 read 0x280fff4 thru 0x2810f65 (0xf72 bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1092 read 0x87ce6b thru 0x87dcc2 (0xe58 bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1093 read 0x21466fd thru 0x214caad (0x63b1 bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1094 read 0x315e07f thru 0x3162cce (0x4c50 bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1096 read 0x6bbbb55 thru 0x6bbc65e (0xb0a bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1101 punch from 0x2ad29f7 to 0x2adf406, (0xca0f bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1103 read 0x6193f7 thru 0x61a044 (0xc4e bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1104 read 0x18cee8e thru 0x18cfbc3 (0xd36 bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:1105 read 0x3712cd2 thru 0x371771c (0x4a4b bytes) 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.897 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.905 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:05.905 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:05.907 INFO:teuthology.orchestra.run.smithi081.stdout:1109 write 0xc211081 thru 0xc215aad (0x4a2d bytes) 2024-09-18T00:32:05.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:05.919 INFO:teuthology.orchestra.run.smithi081.stdout:1111 write 0xc639108 thru 0xc648f0a (0xfe03 bytes) 2024-09-18T00:32:05.933 INFO:teuthology.orchestra.run.smithi081.stdout:1112 read 0x80fc130 thru 0x81062d3 (0xa1a4 bytes) 2024-09-18T00:32:05.933 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.933 INFO:teuthology.orchestra.run.smithi081.stdout:1114 punch from 0xb2865fe to 0xb28a9e4, (0x43e6 bytes) 2024-09-18T00:32:05.933 INFO:teuthology.orchestra.run.smithi081.stdout:1115 write 0x30b9add thru 0x30bbd52 (0x2276 bytes) 2024-09-18T00:32:05.934 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:05.934 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:05.934 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-18T00:32:05.934 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T00:32:05.934 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T00:32:05.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-18T00:32:05.939 INFO:teuthology.orchestra.run.smithi081.stdout:1117 write 0x5255b59 thru 0x5262cc4 (0xd16c bytes) 2024-09-18T00:32:05.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:32:05.952 INFO:teuthology.orchestra.run.smithi081.stdout:1119 write 0x720db70 thru 0x7211501 (0x3992 bytes) 2024-09-18T00:32:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:1121 write 0x5e9b9e7 thru 0x5ea7e36 (0xc450 bytes) 2024-09-18T00:32:05.956 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:05.955+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:05.970 INFO:teuthology.orchestra.run.smithi081.stdout:1122 write 0xb1b5ab3 thru 0xb1c10db (0xb629 bytes) 2024-09-18T00:32:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:1123 read 0xafe0f00 thru 0xafe3093 (0x2194 bytes) 2024-09-18T00:32:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:1125 read 0xa6db359 thru 0xa6e69f9 (0xb6a1 bytes) 2024-09-18T00:32:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:1126 read 0xae4eefc thru 0xae55fd0 (0x70d5 bytes) 2024-09-18T00:32:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:1127 punch from 0x6015056 to 0x601d605, (0x85af bytes) 2024-09-18T00:32:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:1128 read 0x5fb17a thru 0x607304 (0xc18b bytes) 2024-09-18T00:32:05.987 INFO:teuthology.orchestra.run.smithi081.stdout:1129 write 0xb99d963 thru 0xb9ac20e (0xe8ac bytes) 2024-09-18T00:32:06.000 INFO:teuthology.orchestra.run.smithi081.stdout:1130 write 0x78248b1 thru 0x7829df2 (0x5542 bytes) 2024-09-18T00:32:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:1131 trunc from 0xc648f0b to 0x79fd418 2024-09-18T00:32:06.035 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:06.036 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:06.042 INFO:teuthology.orchestra.run.smithi081.stdout:1132 trunc from 0x79fd418 to 0x19f2696 2024-09-18T00:32:06.044 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:06.043+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:06.061 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:06.076 INFO:teuthology.orchestra.run.smithi081.stdout:1133 write 0x63c34f5 thru 0x63d13ff (0xdf0b bytes) 2024-09-18T00:32:06.083 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:06.087 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:06.088 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T00:32:06.088 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:06.089 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:06.089 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:06.089 INFO:teuthology.orchestra.run.smithi081.stdout:1134 read 0x24cc00d thru 0x24d764f (0xb643 bytes) 2024-09-18T00:32:06.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:06.100 INFO:teuthology.orchestra.run.smithi081.stdout:1135 trunc from 0x63d1400 to 0xe2f0494 2024-09-18T00:32:06.106 INFO:teuthology.orchestra.run.smithi081.stdout:1136 read 0x49e0264 thru 0x49e6e17 (0x6bb4 bytes) 2024-09-18T00:32:06.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:06.123 INFO:teuthology.orchestra.run.smithi081.stdout:1138 trunc from 0xe2f0494 to 0x18bf549 2024-09-18T00:32:06.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:06.145 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:06.143+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:06.155 INFO:teuthology.orchestra.run.smithi081.stdout:1140 write 0xa74f2d1 thru 0xa751123 (0x1e53 bytes) 2024-09-18T00:32:06.160 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:06.161 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:06.161 INFO:teuthology.orchestra.run.smithi081.stdout:1141 write 0x428ba15 thru 0x429265c (0x6c48 bytes) 2024-09-18T00:32:06.173 INFO:teuthology.orchestra.run.smithi081.stdout:1142 punch from 0x276f882 to 0x2775b3d, (0x62bb bytes) 2024-09-18T00:32:06.174 INFO:teuthology.orchestra.run.smithi081.stdout:1143 write 0x2c100f2 thru 0x2c16dbf (0x6cce bytes) 2024-09-18T00:32:06.179 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:06.183 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:06.183 INFO:teuthology.orchestra.run.smithi081.stdout:1146 read 0x4d2a60f thru 0x4d376e9 (0xd0db bytes) 2024-09-18T00:32:06.183 INFO:teuthology.orchestra.run.smithi081.stdout:1150 punch from 0x384241e to 0x3845bb3, (0x3795 bytes) 2024-09-18T00:32:06.183 INFO:teuthology.orchestra.run.smithi081.stdout:1151 read 0x37c2796 thru 0x37cb5cf (0x8e3a bytes) 2024-09-18T00:32:06.183 INFO:teuthology.orchestra.run.smithi081.stdout:1152 read 0x229786b thru 0x229fd33 (0x84c9 bytes) 2024-09-18T00:32:06.195 INFO:teuthology.orchestra.run.smithi081.stdout:1154 trunc from 0xa751124 to 0x10792a0 2024-09-18T00:32:06.218 INFO:teuthology.orchestra.run.smithi081.stdout:1156 writesame 0x56f6a62 thru 0x56f9b74 data_size 0x1(0x3113 bytes) 2024-09-18T00:32:06.218 INFO:teuthology.orchestra.run.smithi081.stdout:1157 trunc from 0x56f9b75 to 0x5285683 2024-09-18T00:32:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:1159 writesame 0x8349c33 thru 0x835735c data_size 0x1(0xd72a bytes) 2024-09-18T00:32:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:1160 read 0x3d7987a thru 0x3d86e9c (0xd623 bytes) 2024-09-18T00:32:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:1161 punch from 0x562abe2 to 0x562b812, (0xc30 bytes) 2024-09-18T00:32:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:1163 punch from 0x529d3d9 to 0x52a4d91, (0x79b8 bytes) 2024-09-18T00:32:06.233 INFO:teuthology.orchestra.run.smithi081.stdout:1164 write 0x113957f thru 0x1146479 (0xcefb bytes) 2024-09-18T00:32:06.245 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:06.244+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:06.246 INFO:teuthology.orchestra.run.smithi081.stdout:1166 trunc from 0x835735d to 0x9371cbe 2024-09-18T00:32:06.251 INFO:teuthology.orchestra.run.smithi081.stdout:1168 write 0x4d4b29b thru 0x4d52a88 (0x77ee bytes) 2024-09-18T00:32:06.260 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:06.263 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:06.263 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:06.270 INFO:teuthology.orchestra.run.smithi081.stdout:1170 writesame 0xb8b542b thru 0xb8bb4c7 data_size 0x1(0x609d bytes) 2024-09-18T00:32:06.270 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:06.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:06.278 INFO:teuthology.orchestra.run.smithi081.stdout:1174 trunc from 0xb8bb4c8 to 0x4dd0251 2024-09-18T00:32:06.302 INFO:teuthology.orchestra.run.smithi081.stdout:1175 write 0xc9f064e thru 0xc9fb485 (0xae38 bytes) 2024-09-18T00:32:06.317 INFO:teuthology.orchestra.run.smithi081.stdout:1176 trunc from 0xc9fb486 to 0x929f10d 2024-09-18T00:32:06.329 INFO:teuthology.orchestra.run.smithi081.stdout:1177 write 0x60af2fc thru 0x60bd88b (0xe590 bytes) 2024-09-18T00:32:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:1179 punch from 0x38edc47 to 0x38fb47d, (0xd836 bytes) 2024-09-18T00:32:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:1182 clone 11 order 25 su 4194304 sc 9 2024-09-18T00:32:06.349 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:06.347+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:06.387 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:06.387 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:06.387 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:06.387 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:06.387 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:06.396 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:06.449 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:06.448+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:06.500 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.14038824, 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:06.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.135039703, 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.506 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:06.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.131299977999999, 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.511 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:06.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.131275609999999, 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.517 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:06.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:06.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:06.521 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.13126303, 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:06.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.131252754, 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.526 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:06.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.530 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.11939857, 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:06.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.1193782, 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.535 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:06.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.117418562999999, 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.540 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:06.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.117409294, 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.544 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.548 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.115395993, 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.549 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:06.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.115377832, 2024-09-18T00:32:06.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:06.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:06.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.113079948999999, 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.558 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:06.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:06.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.113039498999999, 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:06.562 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:06.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:06.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.112944003000001, 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.572 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:06.573 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.111368278, 2024-09-18T00:32:06.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:06.573 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.573 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.573 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:06.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:06.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.579 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.11134756, 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.580 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.111324027, 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.111301428999999, 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:06.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:06.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:06.598 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.109345872, 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:06.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:06.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:06.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:06.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:06.604 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:06.606 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:06.606 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:06.604+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:06.707 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:06.705+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:06.752 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:06.752 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:06.752 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:06.752 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:06.758 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:06.842 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:06.841+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:06.901 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:06.901 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:06.901 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:06.902 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:06.902 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:06.908 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:06.907+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:06.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:32:07.009 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:07.007+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone10 from 0x929f10d (overlap 0x1699e0) to 0x0 2024-09-18T00:32:07.066 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1631 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 675840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.711239214000001, 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047626628999999997, 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.067 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1631 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353197+0000", 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353198+0000", 2024-09-18T00:32:07.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2449999999999999e-06 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353201+0000", 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.399e-06 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353205+0000", 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5760000000000002e-06 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400685+0000", 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047480517999999999 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400769+0000", 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3473000000000005e-05 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400823+0000", 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4137e-05 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.071 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1632 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.711227149999999, 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047756706000000003, 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.072 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1632 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353209+0000", 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353210+0000", 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.514e-06 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353216+0000", 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3920000000000002e-06 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353219+0000", 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.315e-06 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400849+0000", 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047630231000000002 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400901+0000", 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1428999999999998e-05 2024-09-18T00:32:07.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400965+0000", 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4543999999999997e-05 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1633 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.711212628, 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868945000000003, 2024-09-18T00:32:07.077 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1633 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354886+0000", 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001662979 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354890+0000", 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:07.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354899+0000", 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3510000000000008e-06 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354906+0000", 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5869999999999998e-06 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400994+0000", 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046087545000000001 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401038+0000", 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4535e-05 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401092+0000", 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3687999999999998e-05 2024-09-18T00:32:07.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1682 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 47104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.70932743, 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047536968999999998, 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.082 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1682 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0100000000000001e-07 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355109+0000", 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8899999999999998e-07 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355112+0000", 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8770000000000002e-06 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355115+0000", 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4030000000000001e-06 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402556+0000", 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047441715000000002 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402596+0000", 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9635000000000003e-05 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402645+0000", 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9149e-05 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1683 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.086 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.709317971000001, 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047646796999999998, 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1683 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:07.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356882+0000", 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001764334 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356890+0000", 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4759999999999998e-06 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356901+0000", 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0533999999999999e-05 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356912+0000", 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1239e-05 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402670+0000", 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045757985000000001 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402713+0000", 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3121000000000003e-05 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402764+0000", 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1107999999999999e-05 2024-09-18T00:32:07.090 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1705 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 706560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.705376286, 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047596718000000003, 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.091 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1705 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360881+0000", 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001821802 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360885+0000", 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4809999999999998e-06 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360892+0000", 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360896+0000", 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6140000000000002e-06 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406437+0000", 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045540046000000001 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406544+0000", 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107112 2024-09-18T00:32:07.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406656+0000", 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011232500000000001 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1715 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 993280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.703378244, 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047689281, 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.095 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1715 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361058+0000", 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361059+0000", 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.697e-06 2024-09-18T00:32:07.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361065+0000", 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.507e-06 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361069+0000", 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.442e-06 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408546+0000", 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047476566999999997 2024-09-18T00:32:07.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408638+0000", 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2218000000000004e-05 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408747+0000", 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108528 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1716 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 1021952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.703360623, 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047884890999999999, 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1716 2024-09-18T00:32:07.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361077+0000", 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.823e-06 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361085+0000", 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5889999999999997e-06 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361089+0000", 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.651e-06 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408783+0000", 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047693194000000001 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408861+0000", 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8220000000000007e-05 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408960+0000", 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9049999999999995e-05 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1754 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 20480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.703340634, 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048097325000000003, 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.104 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1754 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361097+0000", 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.714e-06 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361104+0000", 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8580000000000002e-06 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361117+0000", 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3118e-05 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408998+0000", 2024-09-18T00:32:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047881263 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409088+0000", 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9918000000000002e-05 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409192+0000", 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104079 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1755 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.703311814999999, 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048258826999999997, 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.109 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1755 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.32e-07 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361126+0000", 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1059999999999998e-06 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361132+0000", 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0299999999999999e-06 2024-09-18T00:32:07.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361137+0000", 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409215+0000", 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048078567000000003 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409294+0000", 2024-09-18T00:32:07.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8467999999999995e-05 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409383+0000", 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8840999999999999e-05 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1756 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 77824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.703293155000001, 2024-09-18T00:32:07.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048360829000000001, 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1756 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361143+0000", 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361154+0000", 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1336e-05 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361161+0000", 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2629999999999997e-06 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361171+0000", 2024-09-18T00:32:07.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3049999999999998e-06 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409408+0000", 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048237447000000003 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409451+0000", 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3284000000000001e-05 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409503+0000", 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1833000000000003e-05 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1757 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.703257725, 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048438623, 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.118 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1757 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362883+0000", 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017047620000000001 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362887+0000", 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1690000000000002e-06 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362897+0000", 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0362e-05 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362905+0000", 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6369999999999999e-06 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409527+0000", 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046622334000000001 2024-09-18T00:32:07.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409566+0000", 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9427e-05 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409616+0000", 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9932000000000002e-05 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1764 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 307200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.701357007, 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047564585999999999, 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1764 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:07.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363081+0000", 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.869e-06 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363087+0000", 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.387e-06 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363092+0000", 2024-09-18T00:32:07.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410478+0000", 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047385746999999999 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410535+0000", 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7154999999999997e-05 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410643+0000", 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108311 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1765 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.701337078, 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047660415999999997, 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.127 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1765 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:07.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363099+0000", 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363102+0000", 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.898e-06 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363108+0000", 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363118+0000", 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9969999999999993e-06 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410660+0000", 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047542415999999997 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410703+0000", 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2231000000000003e-05 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410759+0000", 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6271999999999999e-05 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.131 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1766 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 364544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.701312356000001, 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868621, 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1766 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.132 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363124+0000", 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363125+0000", 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.48e-06 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363129+0000", 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7579999999999998e-06 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363131+0000", 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5320000000000001e-06 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410797+0000", 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047665893000000001 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410892+0000", 2024-09-18T00:32:07.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4406000000000004e-05 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410992+0000", 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100191 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1767 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 393216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:07.136 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.701301027, 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047993455999999997, 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1767 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:07.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363135+0000", 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0599999999999999e-07 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363139+0000", 2024-09-18T00:32:07.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5249999999999999e-06 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363143+0000", 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3550000000000001e-06 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363145+0000", 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411022+0000", 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047877292000000002 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411073+0000", 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0528999999999997e-05 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411128+0000", 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4923000000000003e-05 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.140 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1768 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.701287041, 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048176798, 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.141 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1768 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364882+0000", 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733917 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364892+0000", 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.577e-06 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364911+0000", 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8868999999999998e-05 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364917+0000", 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8640000000000001e-06 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411156+0000", 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046238915999999998 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411220+0000", 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4751000000000004e-05 2024-09-18T00:32:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411325+0000", 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104904 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1775 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 622592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.699393419, 2024-09-18T00:32:07.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047673465999999998, 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1775 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365044+0000", 2024-09-18T00:32:07.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1200000000000001e-06 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365047+0000", 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.269e-06 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365049+0000", 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5720000000000001e-06 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412581+0000", 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047531363 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412636+0000", 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4969999999999997e-05 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412716+0000", 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9861e-05 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.149 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1776 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.699383038000001, 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047805461, 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1776 2024-09-18T00:32:07.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365053+0000", 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365054+0000", 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0189999999999999e-06 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365057+0000", 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0299999999999998e-06 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365059+0000", 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4619999999999999e-06 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412745+0000", 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047685412000000003 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412795+0000", 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9904000000000002e-05 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412858+0000", 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3406999999999998e-05 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1777 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 14.699373368, 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047940417999999999, 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:07.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1777 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366880+0000", 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018183279999999999 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366884+0000", 2024-09-18T00:32:07.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.002e-06 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366896+0000", 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1119e-05 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366905+0000", 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4930000000000004e-06 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:07.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412893+0000", 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045988345999999999 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412947+0000", 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413003+0000", 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5770999999999998e-05 2024-09-18T00:32:07.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:07.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:07.159 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:07.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:07.164 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-18T00:32:07.164 INFO:teuthology.orchestra.run.smithi081.stdout:1183 write 0x8080d5d thru 0x8082a2b (0x1ccf bytes) 2024-09-18T00:32:07.164 INFO:teuthology.orchestra.run.smithi081.stdout:1184 read 0x467b971 thru 0x46818b7 (0x5f47 bytes) 2024-09-18T00:32:07.164 INFO:teuthology.orchestra.run.smithi081.stdout:1185 punch from 0x3c75134 to 0x3c7c36c, (0x7238 bytes) 2024-09-18T00:32:07.165 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.165 INFO:teuthology.orchestra.run.smithi081.stdout:1187 read 0x28ef297 thru 0x28f0c8a (0x19f4 bytes) 2024-09-18T00:32:07.165 INFO:teuthology.orchestra.run.smithi081.stdout:1190 read 0x8d7194f thru 0x8d7d00d (0xb6bf bytes) 2024-09-18T00:32:07.165 INFO:teuthology.orchestra.run.smithi081.stdout:1191 writesame 0x92d02cd thru 0x92d3269 data_size 0x11(0x2f9d bytes) 2024-09-18T00:32:07.165 INFO:teuthology.orchestra.run.smithi081.stdout:1192 read 0x8230fe9 thru 0x823d5a3 (0xc5bb bytes) 2024-09-18T00:32:07.165 INFO:teuthology.orchestra.run.smithi081.stdout:1193 trunc from 0x92d326a to 0xcdd9a4b 2024-09-18T00:32:07.165 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:07.159+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:07.169 INFO:teuthology.orchestra.run.smithi081.stdout:1194 trunc from 0xcdd9a4b to 0x16b6a7 2024-09-18T00:32:07.184 INFO:teuthology.orchestra.run.smithi081.stdout:1196 write 0xe608ec thru 0xe6e2e0 (0xd9f5 bytes) 2024-09-18T00:32:07.187 INFO:teuthology.orchestra.run.smithi081.stdout:1197 punch from 0x9692ee to 0x973eae, (0xabc0 bytes) 2024-09-18T00:32:07.200 INFO:teuthology.orchestra.run.smithi081.stdout:1198 write 0x6c9dbf9 thru 0x6ca4b82 (0x6f8a bytes) 2024-09-18T00:32:07.201 INFO:teuthology.orchestra.run.smithi081.stdout:1199 read 0x36f8049 thru 0x3704bcf (0xcb87 bytes) 2024-09-18T00:32:07.202 INFO:teuthology.orchestra.run.smithi081.stdout:1200 writesame 0x29a112f thru 0x29a6b35 data_size 0x1(0x5a07 bytes) 2024-09-18T00:32:07.214 INFO:teuthology.orchestra.run.smithi081.stdout:1201 writesame 0x8faaf5 thru 0x8fdab9 data_size 0x1(0x2fc5 bytes) 2024-09-18T00:32:07.223 INFO:teuthology.orchestra.run.smithi081.stdout:1202 read 0x1da6e05 thru 0x1db4d9a (0xdf96 bytes) 2024-09-18T00:32:07.223 INFO:teuthology.orchestra.run.smithi081.stdout:1203 punch from 0x426ed75 to 0x4271d6b, (0x2ff6 bytes) 2024-09-18T00:32:07.223 INFO:teuthology.orchestra.run.smithi081.stdout:1204 punch from 0x49f6d90 to 0x49fda39, (0x6ca9 bytes) 2024-09-18T00:32:07.223 INFO:teuthology.orchestra.run.smithi081.stdout:1206 write 0x457101 thru 0x4576ed (0x5ed bytes) 2024-09-18T00:32:07.229 INFO:teuthology.orchestra.run.smithi081.stdout:1207 trunc from 0x6ca4b83 to 0x30c8b9a 2024-09-18T00:32:07.252 INFO:teuthology.orchestra.run.smithi081.stdout:1208 write 0xa65524a thru 0xa65ab6a (0x5921 bytes) 2024-09-18T00:32:07.255 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.255 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.255 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.255 INFO:teuthology.orchestra.run.smithi081.stdout:1218 read 0x931c88d thru 0x9325dab (0x951f bytes) 2024-09-18T00:32:07.256 INFO:teuthology.orchestra.run.smithi081.stdout:1221 read 0x1f135a2 thru 0x1f16e05 (0x3864 bytes) 2024-09-18T00:32:07.256 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.256 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.261 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:07.259+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:07.262 INFO:teuthology.orchestra.run.smithi081.stdout:1225 write 0xac1a2f2 thru 0xac1ddc5 (0x3ad4 bytes) 2024-09-18T00:32:07.265 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:07.265 INFO:teuthology.orchestra.run.smithi081.stdout:1229 read 0x1549614 thru 0x15519ab (0x8398 bytes) 2024-09-18T00:32:07.265 INFO:teuthology.orchestra.run.smithi081.stdout:1230 write 0x60db092 thru 0x60db522 (0x491 bytes) 2024-09-18T00:32:07.269 INFO:teuthology.orchestra.run.smithi081.stdout:1231 punch from 0x665cac1 to 0x666ba9d, (0xefdc bytes) 2024-09-18T00:32:07.270 INFO:teuthology.orchestra.run.smithi081.stdout:1232 trunc from 0xac1ddc6 to 0xb2c0d89 2024-09-18T00:32:07.275 INFO:teuthology.orchestra.run.smithi081.stdout:1233 trunc from 0xb2c0d89 to 0xa7da56e 2024-09-18T00:32:07.281 INFO:teuthology.orchestra.run.smithi081.stdout:1234 read 0x6c73766 thru 0x6c7bed2 (0x876d bytes) 2024-09-18T00:32:07.281 INFO:teuthology.orchestra.run.smithi081.stdout:1235 write 0x1d0c20e thru 0x1d18e22 (0xcc15 bytes) 2024-09-18T00:32:07.283 INFO:teuthology.orchestra.run.smithi081.stdout:1236 punch from 0x52ed90 to 0x53be13, (0xd083 bytes) 2024-09-18T00:32:07.283 INFO:teuthology.orchestra.run.smithi081.stdout:1237 clone 12 order 18 su 131072 sc 13 2024-09-18T00:32:07.283 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:07.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:07.283 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:07.283 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:07.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:07.377 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:07.375+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:07.436 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:07.436 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:07.437 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:07.437 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:07.437 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:07.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:07.487 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:07.485+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:07.564 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:07.562+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5129 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624179354000001, 2024-09-18T00:32:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028611574000000001, 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5129 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964567+0000", 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0899999999999997e-07 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964568+0000", 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8050000000000001e-06 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964577+0000", 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3149999999999992e-06 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964581+0000", 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4789999999999998e-06 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993004+0000", 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028422612 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993083+0000", 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9367000000000001e-05 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993178+0000", 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4686999999999997e-05 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5130 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624159025999999, 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029079462, 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5130 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0100000000000001e-07 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964593+0000", 2024-09-18T00:32:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0809999999999999e-06 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964599+0000", 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9660000000000001e-06 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964603+0000", 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3340000000000003e-06 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993209+0000", 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028605815 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993577+0000", 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036788599999999999 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993666+0000", 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9079000000000006e-05 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5168 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 26624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624136869000001, 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02923388, 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5168 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964611+0000", 2024-09-18T00:32:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6390000000000001e-06 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964616+0000", 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1880000000000001e-06 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964620+0000", 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993694+0000", 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029073485 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993763+0000", 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9064000000000001e-05 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993843+0000", 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9919999999999994e-05 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5169 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624120345, 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029406055, 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5169 2024-09-18T00:32:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964626+0000", 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964627+0000", 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6649999999999999e-06 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964633+0000", 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964637+0000", 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.189e-06 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993870+0000", 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029233424000000001 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993951+0000", 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1051999999999996e-05 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994031+0000", 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0019999999999996e-05 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5170 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 83968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.62410395, 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029576037999999999, 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5170 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964644+0000", 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5540000000000001e-06 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964650+0000", 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0950000000000001e-06 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964654+0000", 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3250000000000001e-06 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994058+0000", 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029403655000000001 2024-09-18T00:32:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994133+0000", 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4974000000000004e-05 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994218+0000", 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5144999999999999e-05 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5171 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624084498, 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030497487, 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5171 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964662+0000", 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964663+0000", 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.722e-06 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964672+0000", 2024-09-18T00:32:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7320000000000004e-06 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964677+0000", 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.527e-06 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994247+0000", 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029570603000000001 2024-09-18T00:32:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995061+0000", 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00081419399999999996 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995159+0000", 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7380999999999995e-05 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5172 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624063736, 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030717230000000002, 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5172 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964691+0000", 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6149999999999997e-06 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964697+0000", 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964705+0000", 2024-09-18T00:32:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0320000000000003e-06 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995209+0000", 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030504452000000001 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995301+0000", 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1367999999999997e-05 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995399+0000", 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8340999999999999e-05 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5173 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624034882, 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030867024, 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5173 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0500000000000004e-07 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964713+0000", 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.84e-06 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964719+0000", 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4600000000000002e-06 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964723+0000", 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995429+0000", 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030706563999999999 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995500+0000", 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0500999999999995e-05 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995578+0000", 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8035999999999996e-05 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5174 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.624018037999999, 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031034297999999998, 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5174 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964730+0000", 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.655e-06 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964735+0000", 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3940000000000004e-06 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964744+0000", 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995603+0000", 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030859780999999999 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995676+0000", 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2704000000000001e-05 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995762+0000", 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5841999999999996e-05 2024-09-18T00:32:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5175 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623996497, 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031208080999999999, 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5175 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964750+0000", 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964751+0000", 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.829e-06 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964757+0000", 2024-09-18T00:32:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3789999999999997e-06 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964761+0000", 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1520000000000002e-06 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995789+0000", 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031028525000000001 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995862+0000", 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2515999999999995e-05 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995957+0000", 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5340000000000005e-05 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5176 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 256000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623979508, 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031341039000000001, 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5176 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964767+0000", 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964768+0000", 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6610000000000001e-06 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964774+0000", 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3850000000000001e-06 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964778+0000", 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995985+0000", 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031206289000000002 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996058+0000", 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2974999999999998e-05 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996107+0000", 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9639999999999999e-05 2024-09-18T00:32:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5177 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 284672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.62396234, 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031522255999999998, 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5177 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964784+0000", 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9200000000000002e-07 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964785+0000", 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6869999999999999e-06 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964797+0000", 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1282e-05 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964801+0000", 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5510000000000001e-06 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996136+0000", 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031334870000000001 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996211+0000", 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4475999999999996e-05 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996306+0000", 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5098000000000003e-05 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5178 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 313344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623938913, 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031735948, 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5178 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964809+0000", 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7630000000000001e-06 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964819+0000", 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0224000000000001e-05 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964824+0000", 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4139999999999996e-06 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996356+0000", 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031532646999999997 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996446+0000", 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9993000000000004e-05 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996543+0000", 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6576000000000005e-05 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5179 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623916075, 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031953505, 2024-09-18T00:32:07.651 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5179 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964837+0000", 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964843+0000", 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.336e-06 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964848+0000", 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4440000000000001e-06 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996593+0000", 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031745821 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996680+0000", 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6953000000000006e-05 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996783+0000", 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010280000000000001 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5180 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 370688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623891759999999, 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032134442999999999, 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5180 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964856+0000", 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964862+0000", 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.519e-06 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964866+0000", 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996812+0000", 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031946039000000002 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996899+0000", 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7064999999999994e-05 2024-09-18T00:32:07.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996988+0000", 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9370999999999995e-05 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5181 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 399360~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623870119999999, 2024-09-18T00:32:07.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.03234393, 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5181 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964878+0000", 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.844e-06 2024-09-18T00:32:07.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964883+0000", 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1100000000000002e-06 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964887+0000", 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9169999999999999e-06 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997032+0000", 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032145646 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997116+0000", 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3858999999999998e-05 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997220+0000", 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010323399999999999 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5182 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623854065, 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032589419000000001, 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5182 2024-09-18T00:32:07.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:07.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964894+0000", 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6700000000000001e-06 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964899+0000", 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1080000000000001e-06 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964903+0000", 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8210000000000003e-06 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997297+0000", 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032394065 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997380+0000", 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3226000000000006e-05 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997481+0000", 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101048 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5183 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623831553, 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032807066000000003, 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5183 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964921+0000", 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964926+0000", 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964934+0000", 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6809999999999998e-06 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997526+0000", 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032591805000000001 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997617+0000", 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1439000000000003e-05 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997721+0000", 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0001039 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5184 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623805763, 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033026119, 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5184 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:07.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964942+0000", 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.846e-06 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964948+0000", 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5489999999999997e-06 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964952+0000", 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1060000000000002e-06 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997766+0000", 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032814589999999998 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997863+0000", 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6146999999999999e-05 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997966+0000", 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103454 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5185 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 514048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.623789107, 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033245331000000003, 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:07.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5185 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:07.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9400000000000001e-07 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964958+0000", 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6160000000000001e-06 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:07.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964969+0000", 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964974+0000", 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2180000000000001e-06 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998013+0000", 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033038901000000002 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998112+0000", 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9028000000000001e-05 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998202+0000", 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0288e-05 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:07.682 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:07.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:07.684 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:07.682+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:07.785 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:07.783+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:07.827 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:07.827 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:07.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:07.885 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:07.884+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:07.938 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:07.938 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:07.939 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:07.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:07.987 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:07.985+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:08.023 INFO:teuthology.orchestra.run.smithi081.stdout:leaving image image_client.0-clone11 intact 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13026 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28901376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9297048350000008, 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011453733000000001, 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13026 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1299999999999999e-07 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130805+0000", 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.136e-06 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130808+0000", 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9450000000000002e-06 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130811+0000", 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6350000000000002e-06 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142149+0000", 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01133849 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142201+0000", 2024-09-18T00:32:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1691999999999999e-05 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142258+0000", 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6622000000000001e-05 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13027 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29687808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130814+0000", 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9296944380000003, 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011578432, 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13027 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130814+0000", 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130814+0000", 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130815+0000", 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.96e-07 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130816+0000", 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.517e-06 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130821+0000", 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130825+0000", 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1659999999999996e-06 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142283+0000", 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0114579 2024-09-18T00:32:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142325+0000", 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2073000000000002e-05 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142393+0000", 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7533999999999994e-05 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13028 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 30474240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9296660570000004, 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011662717, 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13028 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1799999999999995e-07 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130845+0000", 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.046e-06 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130851+0000", 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130855+0000", 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4669999999999998e-06 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142420+0000", 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011564928 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142459+0000", 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9159999999999998e-05 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142505+0000", 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5878999999999999e-05 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13029 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 31260672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130864+0000", 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9296445030000005, 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011799693, 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13029 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130864+0000", 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130864+0000", 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130865+0000", 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9700000000000002e-07 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130867+0000", 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1019999999999999e-06 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130877+0000", 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0339999999999999e-05 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130882+0000", 2024-09-18T00:32:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8149999999999996e-06 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142531+0000", 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011649267 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142597+0000", 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5804999999999998e-05 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142664+0000", 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6966999999999998e-05 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13054 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 25821184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131134+0000", 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9293745209999997, 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011644855000000001, 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13054 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131134+0000", 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131134+0000", 2024-09-18T00:32:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131135+0000", 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4300000000000001e-07 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131140+0000", 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0599999999999998e-06 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131156+0000", 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5679999999999999e-05 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131164+0000", 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6839999999999996e-06 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142688+0000", 2024-09-18T00:32:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011524895 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142728+0000", 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9875e-05 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142779+0000", 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0717999999999998e-05 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13055 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 26607616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131176+0000", 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9293324950000006, 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011734448, 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13055 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131176+0000", 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131176+0000", 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131177+0000", 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7999999999999996e-07 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131179+0000", 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5220000000000002e-06 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131187+0000", 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5719999999999997e-06 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131194+0000", 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1799999999999999e-06 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142807+0000", 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011612577000000001 2024-09-18T00:32:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142851+0000", 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4286000000000003e-05 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142911+0000", 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9830999999999997e-05 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13056 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 27394048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131215+0000", 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9292936990000005, 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011828554, 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13056 2024-09-18T00:32:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131215+0000", 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131215+0000", 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131216+0000", 2024-09-18T00:32:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3399999999999999e-07 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131218+0000", 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131226+0000", 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131232+0000", 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142937+0000", 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011705278 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142980+0000", 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2781999999999998e-05 2024-09-18T00:32:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143044+0000", 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3399999999999996e-05 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13057 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28180480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131240+0000", 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9292683230000005, 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011995570000000001, 2024-09-18T00:32:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13057 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131240+0000", 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131240+0000", 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131241+0000", 2024-09-18T00:32:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131243+0000", 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.99e-06 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131252+0000", 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9870000000000005e-06 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131258+0000", 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143087+0000", 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011829162000000001 2024-09-18T00:32:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143161+0000", 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3782000000000006e-05 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143236+0000", 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4727999999999993e-05 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13058 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28966912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9292438339999993, 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012156356, 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13058 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8799999999999998e-07 2024-09-18T00:32:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131267+0000", 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.956e-06 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131273+0000", 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1539999999999999e-06 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131278+0000", 2024-09-18T00:32:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.87e-06 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143280+0000", 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012001357000000001 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143346+0000", 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6618000000000005e-05 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143421+0000", 2024-09-18T00:32:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5012999999999995e-05 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13059 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29753344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9292238939999997, 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012304376000000001, 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13059 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131288+0000", 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8710000000000001e-06 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131295+0000", 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4100000000000002e-06 2024-09-18T00:32:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131301+0000", 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4110000000000004e-06 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143449+0000", 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012148096000000001 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143506+0000", 2024-09-18T00:32:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143589+0000", 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3234999999999998e-05 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13060 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 30539776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.929201655, 2024-09-18T00:32:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012436137999999999, 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13060 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131309+0000", 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.875e-06 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131315+0000", 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0900000000000001e-06 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131320+0000", 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1150000000000002e-06 2024-09-18T00:32:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143614+0000", 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012293024 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143671+0000", 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7200999999999997e-05 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143743+0000", 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2463000000000001e-05 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13061 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 31326208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.117 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131326+0000", 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9291824460000004, 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012591569, 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13061 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131326+0000", 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131326+0000", 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131327+0000", 2024-09-18T00:32:08.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5100000000000001e-07 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131328+0000", 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8419999999999999e-06 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131334+0000", 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4349999999999996e-06 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131338+0000", 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3760000000000001e-06 2024-09-18T00:32:08.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143778+0000", 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012439317 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143843+0000", 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5845000000000004e-05 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143918+0000", 2024-09-18T00:32:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4402999999999999e-05 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13086 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 25886720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131478+0000", 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9290302490000002, 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012587889999999999, 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13086 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131478+0000", 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131478+0000", 2024-09-18T00:32:08.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131479+0000", 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6400000000000001e-07 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131483+0000", 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6859999999999999e-06 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131493+0000", 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7189999999999996e-06 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131504+0000", 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1279e-05 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143958+0000", 2024-09-18T00:32:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012454174 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144012+0000", 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3919999999999999e-05 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144066+0000", 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4348000000000002e-05 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13087 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 26673152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131514+0000", 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9289945169999996, 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012688687000000001, 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13087 2024-09-18T00:32:08.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131514+0000", 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131514+0000", 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131515+0000", 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6899999999999998e-07 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131518+0000", 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.269e-06 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131525+0000", 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6919999999999996e-06 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131530+0000", 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1089999999999997e-06 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144101+0000", 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012571018 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144151+0000", 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0379e-05 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144203+0000", 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1751e-05 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13088 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 27459584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131554+0000", 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9289543669999993, 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012781377999999999, 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13088 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131554+0000", 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131554+0000", 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131555+0000", 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8800000000000002e-07 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131557+0000", 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2680000000000001e-06 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131565+0000", 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5730000000000002e-06 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131570+0000", 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.276e-06 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144233+0000", 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012663232999999999 2024-09-18T00:32:08.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144282+0000", 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8378000000000003e-05 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144336+0000", 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4061999999999998e-05 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13089 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28246016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9289188500000005, 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012888778, 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13089 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.82e-07 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131593+0000", 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.542e-06 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131600+0000", 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2309999999999999e-06 2024-09-18T00:32:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131605+0000", 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.203e-06 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144375+0000", 2024-09-18T00:32:08.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01276975 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144419+0000", 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4088000000000002e-05 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144479+0000", 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9382000000000002e-05 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13090 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29032448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9288961620000009, 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013068735, 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13090 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131615+0000", 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9139999999999998e-06 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131622+0000", 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7560000000000002e-06 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131630+0000", 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7329999999999992e-06 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144519+0000", 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012889147 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144602+0000", 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2424999999999998e-05 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144681+0000", 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9379e-05 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13091 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29818880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9288699729999994, 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013222229, 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13091 2024-09-18T00:32:08.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9299999999999999e-07 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131641+0000", 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8679999999999999e-06 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131649+0000", 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.79e-06 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131653+0000", 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6500000000000004e-06 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144709+0000", 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013055832 2024-09-18T00:32:08.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144768+0000", 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8591000000000002e-05 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144861+0000", 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3104999999999997e-05 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13092 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 30605312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.928849542, 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013375326, 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.152 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13092 2024-09-18T00:32:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5600000000000001e-07 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131661+0000", 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9829999999999999e-06 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131668+0000", 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0460000000000002e-06 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131674+0000", 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1489999999999999e-06 2024-09-18T00:32:08.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144911+0000", 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013237034999999999 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144971+0000", 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0044000000000003e-05 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145034+0000", 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3713000000000005e-05 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13093 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 31391744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:08.157 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9288221639999996, 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013486318000000001, 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13093 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:08.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1500000000000005e-07 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131689+0000", 2024-09-18T00:32:08.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131695+0000", 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2589999999999997e-06 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131700+0000", 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7249999999999997e-06 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:08.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145056+0000", 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013356178 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145105+0000", 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9023000000000001e-05 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145173+0000", 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7521000000000006e-05 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:08.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:08.162 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:08.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:08.165 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-18T00:32:08.165 INFO:teuthology.orchestra.run.smithi081.stdout:1238 punch from 0x66066f to 0x6701ae, (0xfb3f bytes) 2024-09-18T00:32:08.165 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:08.162+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:08.169 INFO:teuthology.orchestra.run.smithi081.stdout:1239 read 0x1eb55ec thru 0x1ebaef5 (0x590a bytes) 2024-09-18T00:32:08.182 INFO:teuthology.orchestra.run.smithi081.stdout:1242 trunc from 0xa7da56e to 0x38283a 2024-09-18T00:32:08.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:08.221 INFO:teuthology.orchestra.run.smithi081.stdout:1243 write 0xe290cb3 thru 0xe29275f (0x1aad bytes) 2024-09-18T00:32:08.224 INFO:teuthology.orchestra.run.smithi081.stdout:1244 read 0xd75cbfc thru 0xd765d7f (0x9184 bytes) 2024-09-18T00:32:08.231 INFO:teuthology.orchestra.run.smithi081.stdout:1245 trunc from 0xe292760 to 0x860bc84 2024-09-18T00:32:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:1246 punch from 0x60d64b2 to 0x60d8ac2, (0x2610 bytes) 2024-09-18T00:32:08.249 INFO:teuthology.orchestra.run.smithi081.stdout:1248 trunc from 0x860bc84 to 0xe38a91d 2024-09-18T00:32:08.264 INFO:teuthology.orchestra.run.smithi081.stdout:1249 trunc from 0xe38a91d to 0x7ba09ba 2024-09-18T00:32:08.264 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:08.263+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:08.269 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:08.270 INFO:teuthology.orchestra.run.smithi081.stdout:1253 punch from 0x299547 to 0x29f7c1, (0x627a bytes) 2024-09-18T00:32:08.270 INFO:teuthology.orchestra.run.smithi081.stdout:1256 read 0x48d1d5a thru 0x48d6539 (0x47e0 bytes) 2024-09-18T00:32:08.270 INFO:teuthology.orchestra.run.smithi081.stdout:1258 read 0x6d315dd thru 0x6d39fc9 (0x89ed bytes) 2024-09-18T00:32:08.277 INFO:teuthology.orchestra.run.smithi081.stdout:1259 write 0x9caeaef thru 0x9cb2782 (0x3c94 bytes) 2024-09-18T00:32:08.281 INFO:teuthology.orchestra.run.smithi081.stdout:1260 read 0x12b12af thru 0x12bd7f2 (0xc544 bytes) 2024-09-18T00:32:08.281 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:08.281 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:08.281 INFO:teuthology.orchestra.run.smithi081.stdout:1263 read 0x557dd39 thru 0x5581148 (0x3410 bytes) 2024-09-18T00:32:08.281 INFO:teuthology.orchestra.run.smithi081.stdout:1264 write 0x4d48c7e thru 0x4d52817 (0x9b9a bytes) 2024-09-18T00:32:08.284 INFO:teuthology.orchestra.run.smithi081.stdout:1266 write 0x66c054d thru 0x66c0f3d (0x9f1 bytes) 2024-09-18T00:32:08.287 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:08.287 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:08.287 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:08.287 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:08.287 INFO:teuthology.orchestra.run.smithi081.stdout:1267 clone 13 order 18 su 1024 sc 8 2024-09-18T00:32:08.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:08.339 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:08.356 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:08.365 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:08.364+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:08.374 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:08.392 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:08.392 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:08.408 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:08.425 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:08.425 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:08.442 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:08.442 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:08.443 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:08.443 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:08.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:08.459 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:08.469 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:08.468+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:08.560 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:08.560 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:08.568 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:08.566+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:08.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:08.668 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:08.667+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:08.671 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:08.671 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:08.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:08.769 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:08.767+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:08.784 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:08.784 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:08.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:08.870 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:08.869+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:08.936 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:08.937 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:08.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:08.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:32:08.989 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:08.988+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:09.047 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone12 from 0x9cb2783 (overlap 0x38283a) to 0x10d8de 2024-09-18T00:32:09.072 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:09.071+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:09.073 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.073 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:09.145 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-18T00:32:09.173 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:09.172+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:09.227 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.227 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.236 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:09.277 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:09.275+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:09.368 INFO:teuthology.orchestra.run.smithi081.stdout:1268 writesame 0x6d7f054 thru 0x6d891d3 data_size 0x88(0xa180 bytes) 2024-09-18T00:32:09.376 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:09.374+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:09.382 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.382 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.382 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.383 INFO:teuthology.orchestra.run.smithi081.stdout:1271 trunc from 0x9cb2783 to 0xa40b54a 2024-09-18T00:32:09.388 INFO:teuthology.orchestra.run.smithi081.stdout:1272 read 0x2ed026e thru 0x2ed73e2 (0x7175 bytes) 2024-09-18T00:32:09.388 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.388 INFO:teuthology.orchestra.run.smithi081.stdout:1274 write 0x311a296 thru 0x31262ee (0xc059 bytes) 2024-09-18T00:32:09.392 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:09.400 INFO:teuthology.orchestra.run.smithi081.stdout:1275 read 0x238c6fb thru 0x238f793 (0x3099 bytes) 2024-09-18T00:32:09.400 INFO:teuthology.orchestra.run.smithi081.stdout:1276 read 0x24280f3 thru 0x242b92a (0x3838 bytes) 2024-09-18T00:32:09.401 INFO:teuthology.orchestra.run.smithi081.stdout:1277 write 0x7422b06 thru 0x742c8da (0x9dd5 bytes) 2024-09-18T00:32:09.420 INFO:teuthology.orchestra.run.smithi081.stdout:1278 writesame 0xb1c8ae4 thru 0xb1d1bfa data_size 0x3(0x9117 bytes) 2024-09-18T00:32:09.420 INFO:teuthology.orchestra.run.smithi081.stdout:1279 write 0x5f37d9d thru 0x5f411c5 (0x9429 bytes) 2024-09-18T00:32:09.431 INFO:teuthology.orchestra.run.smithi081.stdout:1281 read 0x6f1bfed thru 0x6f27f57 (0xbf6b bytes) 2024-09-18T00:32:09.431 INFO:teuthology.orchestra.run.smithi081.stdout:1282 write 0x2974461 thru 0x297c338 (0x7ed8 bytes) 2024-09-18T00:32:09.445 INFO:teuthology.orchestra.run.smithi081.stdout:1283 read 0xa8b9f71 thru 0xa8c45e2 (0xa672 bytes) 2024-09-18T00:32:09.445 INFO:teuthology.orchestra.run.smithi081.stdout:1284 punch from 0x4df7710 to 0x4e05fa7, (0xe897 bytes) 2024-09-18T00:32:09.446 INFO:teuthology.orchestra.run.smithi081.stdout:1285 write 0x8fb06f8 thru 0x8fbad98 (0xa6a1 bytes) 2024-09-18T00:32:09.461 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.461 INFO:teuthology.orchestra.run.smithi081.stdout:1288 write 0x1af7f73 thru 0x1afa202 (0x2290 bytes) 2024-09-18T00:32:09.477 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:09.476+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:09.482 INFO:teuthology.orchestra.run.smithi081.stdout:1289 trunc from 0xb1d1bfb to 0x62c9676 2024-09-18T00:32:09.509 INFO:teuthology.orchestra.run.smithi081.stdout:1290 write 0x4860e6 thru 0x4935fa (0xd515 bytes) 2024-09-18T00:32:09.519 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.519 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.531 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:09.565 INFO:teuthology.orchestra.run.smithi081.stdout:1291 writesame 0xa984d3c thru 0xa98cfaa data_size 0x1(0x826f bytes) 2024-09-18T00:32:09.565 INFO:teuthology.orchestra.run.smithi081.stdout:1295 write 0x5124391 thru 0x51251e7 (0xe57 bytes) 2024-09-18T00:32:09.573 INFO:teuthology.orchestra.run.smithi081.stdout:1296 read 0x939ae0b thru 0x939c55d (0x1753 bytes) 2024-09-18T00:32:09.573 INFO:teuthology.orchestra.run.smithi081.stdout:1297 write 0x626f909 thru 0x627dc32 (0xe32a bytes) 2024-09-18T00:32:09.577 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:09.576+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:09.588 INFO:teuthology.orchestra.run.smithi081.stdout:1299 trunc from 0xa98cfab to 0x27795a9 2024-09-18T00:32:09.624 INFO:teuthology.orchestra.run.smithi081.stdout:1300 punch from 0x5f5287 to 0x5f5b24, (0x89d bytes) 2024-09-18T00:32:09.624 INFO:teuthology.orchestra.run.smithi081.stdout:1301 read 0x1ef397f thru 0x1f02714 (0xed96 bytes) 2024-09-18T00:32:09.624 INFO:teuthology.orchestra.run.smithi081.stdout:1307 write 0x50d5bd thru 0x50ef98 (0x19dc bytes) 2024-09-18T00:32:09.628 INFO:teuthology.orchestra.run.smithi081.stdout:1308 punch from 0x15da48c to 0x15e39d9, (0x954d bytes) 2024-09-18T00:32:09.635 INFO:teuthology.orchestra.run.smithi081.stdout:1309 writesame 0x409a4c7 thru 0x40a0083 data_size 0x3d(0x5bbd bytes) 2024-09-18T00:32:09.635 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.636 INFO:teuthology.orchestra.run.smithi081.stdout:1312 writesame 0x77a902 thru 0x784470 data_size 0x1(0x9b6f bytes) 2024-09-18T00:32:09.649 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.649 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:09.665 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.665 INFO:teuthology.orchestra.run.smithi081.stdout:1314 read 0xf13f99 thru 0xf1607f (0x20e7 bytes) 2024-09-18T00:32:09.665 INFO:teuthology.orchestra.run.smithi081.stdout:1316 read 0x26243fb thru 0x26266ab (0x22b1 bytes) 2024-09-18T00:32:09.682 INFO:teuthology.orchestra.run.smithi081.stdout:1317 write 0xd0290de thru 0xd038819 (0xf73c bytes) 2024-09-18T00:32:09.695 INFO:teuthology.orchestra.run.smithi081.stdout:1318 punch from 0x581f798 to 0x5824fff, (0x5867 bytes) 2024-09-18T00:32:09.695 INFO:teuthology.orchestra.run.smithi081.stdout:1319 writesame 0x36392a0 thru 0x363b837 data_size 0xc(0x2598 bytes) 2024-09-18T00:32:09.702 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:09.701+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:09.705 INFO:teuthology.orchestra.run.smithi081.stdout:1320 punch from 0x18bf128 to 0x18c943f, (0xa317 bytes) 2024-09-18T00:32:09.705 INFO:teuthology.orchestra.run.smithi081.stdout:1321 write 0x739696a thru 0x73a1c6d (0xb304 bytes) 2024-09-18T00:32:09.718 INFO:teuthology.orchestra.run.smithi081.stdout:1322 write 0x8659b69 thru 0x8661559 (0x79f1 bytes) 2024-09-18T00:32:09.732 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:1326 read 0x82d257c thru 0x82d5096 (0x2b1b bytes) 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:1327 punch from 0x6a1bd7f to 0x6a1bf97, (0x218 bytes) 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:1329 punch from 0x6e3f323 to 0x6e4b97e, (0xc65b bytes) 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:1330 punch from 0x8ce5740 to 0x8cf1847, (0xc107 bytes) 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:1332 read 0xcc730ea thru 0xcc7765e (0x4575 bytes) 2024-09-18T00:32:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:1333 writesame 0xa3ee633 thru 0xa3ee92c data_size 0x6(0x2fa bytes) 2024-09-18T00:32:09.739 INFO:teuthology.orchestra.run.smithi081.stdout:1334 trunc from 0xd03881a to 0xc81fc23 2024-09-18T00:32:09.756 INFO:teuthology.orchestra.run.smithi081.stdout:1335 punch from 0x7588b88 to 0x758a1af, (0x1627 bytes) 2024-09-18T00:32:09.756 INFO:teuthology.orchestra.run.smithi081.stdout:1336 write 0x34795e4 thru 0x3487b88 (0xe5a5 bytes) 2024-09-18T00:32:09.778 INFO:teuthology.orchestra.run.smithi081.stdout:1338 write 0xeaafa00 thru 0xeabdda9 (0xe3aa bytes) 2024-09-18T00:32:09.779 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:09.777+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:09.784 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.784 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.789 INFO:teuthology.orchestra.run.smithi081.stdout:1339 writesame 0x739efbc thru 0x73abf25 data_size 0x8b(0xcf6a bytes) 2024-09-18T00:32:09.792 INFO:teuthology.orchestra.run.smithi081.stdout:1340 write 0x1bbf43 thru 0x1c9bf5 (0xdcb3 bytes) 2024-09-18T00:32:09.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:09.879 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:09.878+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:09.939 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:09.939 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:09.950 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:32:10.015 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:10.014+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:10.057 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:10.057 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:10.066 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:10.082 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:10.080+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:10.085 INFO:teuthology.orchestra.run.smithi081.stdout:1341 read 0x1ceee8 thru 0x1d12a7 (0x23c0 bytes) 2024-09-18T00:32:10.086 INFO:teuthology.orchestra.run.smithi081.stdout:1342 read 0x8a04019 thru 0x8a0c996 (0x897e bytes) 2024-09-18T00:32:10.087 INFO:teuthology.orchestra.run.smithi081.stdout:1343 write 0x5b34d48 thru 0x5b3c145 (0x73fe bytes) 2024-09-18T00:32:10.098 INFO:teuthology.orchestra.run.smithi081.stdout:1345 read 0x8e6f85d thru 0x8e70148 (0x8ec bytes) 2024-09-18T00:32:10.098 INFO:teuthology.orchestra.run.smithi081.stdout:1346 writesame 0x955d04f thru 0x955e5fe data_size 0x8(0x15b0 bytes) 2024-09-18T00:32:10.108 INFO:teuthology.orchestra.run.smithi081.stdout:1347 punch from 0xb22e604 to 0xb2331b2, (0x4bae bytes) 2024-09-18T00:32:10.108 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.108 INFO:teuthology.orchestra.run.smithi081.stdout:1350 punch from 0x8695921 to 0x86a4b1e, (0xf1fd bytes) 2024-09-18T00:32:10.108 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.108 INFO:teuthology.orchestra.run.smithi081.stdout:1354 punch from 0x2ba608b to 0x2bae0a4, (0x8019 bytes) 2024-09-18T00:32:10.109 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.109 INFO:teuthology.orchestra.run.smithi081.stdout:1357 writesame 0x507691e thru 0x5082bb6 data_size 0x1(0xc299 bytes) 2024-09-18T00:32:10.154 INFO:teuthology.orchestra.run.smithi081.stdout:1358 trunc from 0xeabddaa to 0x56f8830 2024-09-18T00:32:10.173 INFO:teuthology.orchestra.run.smithi081.stdout:1359 read 0x4a44711 thru 0x4a4a073 (0x5963 bytes) 2024-09-18T00:32:10.181 INFO:teuthology.orchestra.run.smithi081.stdout:1360 write 0x7ac1b44 thru 0x7acc1a1 (0xa65e bytes) 2024-09-18T00:32:10.182 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:10.180+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:10.183 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:10.183 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:10.192 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.192 INFO:teuthology.orchestra.run.smithi081.stdout:1362 writesame 0x130e642 thru 0x131e515 data_size 0x5e(0xfed4 bytes) 2024-09-18T00:32:10.195 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:10.207 INFO:teuthology.orchestra.run.smithi081.stdout:1363 punch from 0x787232e to 0x7874141, (0x1e13 bytes) 2024-09-18T00:32:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:1364 read 0x333c3ea thru 0x333f5b2 (0x31c9 bytes) 2024-09-18T00:32:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:1365 punch from 0x78e1e72 to 0x78e541d, (0x35ab bytes) 2024-09-18T00:32:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:1366 read 0x3ffe388 thru 0x40037bc (0x5435 bytes) 2024-09-18T00:32:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:1368 read 0x3cfb96 thru 0x3dad0a (0xb175 bytes) 2024-09-18T00:32:10.209 INFO:teuthology.orchestra.run.smithi081.stdout:1370 punch from 0x77cf661 to 0x77d064e, (0xfed bytes) 2024-09-18T00:32:10.209 INFO:teuthology.orchestra.run.smithi081.stdout:1371 write 0x3f6d0e5 thru 0x3f72fc1 (0x5edd bytes) 2024-09-18T00:32:10.221 INFO:teuthology.orchestra.run.smithi081.stdout:1372 trunc from 0x7acc1a2 to 0x7ef79b7 2024-09-18T00:32:10.232 INFO:teuthology.orchestra.run.smithi081.stdout:1373 trunc from 0x7ef79b7 to 0xd5d883f 2024-09-18T00:32:10.237 INFO:teuthology.orchestra.run.smithi081.stdout:1374 read 0x29cb6eb thru 0x29cdb12 (0x2428 bytes) 2024-09-18T00:32:10.244 INFO:teuthology.orchestra.run.smithi081.stdout:1375 trunc from 0xd5d883f to 0x812ac19 2024-09-18T00:32:10.250 INFO:teuthology.orchestra.run.smithi081.stdout:1378 write 0x29b8f5d thru 0x29bdde9 (0x4e8d bytes) 2024-09-18T00:32:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:1379 write 0x9d1d802 thru 0x9d28b46 (0xb345 bytes) 2024-09-18T00:32:10.282 INFO:teuthology.orchestra.run.smithi081.stdout:1380 read 0x90fe75a thru 0x9100f03 (0x27aa bytes) 2024-09-18T00:32:10.283 INFO:teuthology.orchestra.run.smithi081.stdout:1381 read 0x61ebf15 thru 0x61f009c (0x4188 bytes) 2024-09-18T00:32:10.283 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.283 INFO:teuthology.orchestra.run.smithi081.stdout:1385 write 0x84243d thru 0x85210a (0xfcce bytes) 2024-09-18T00:32:10.283 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:10.281+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:10.294 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.294 INFO:teuthology.orchestra.run.smithi081.stdout:1388 read 0x422489b thru 0x4224e6c (0x5d2 bytes) 2024-09-18T00:32:10.294 INFO:teuthology.orchestra.run.smithi081.stdout:1391 read 0x2e63fdb thru 0x2e67073 (0x3099 bytes) 2024-09-18T00:32:10.295 INFO:teuthology.orchestra.run.smithi081.stdout:1392 punch from 0x338bd63 to 0x3397cf1, (0xbf8e bytes) 2024-09-18T00:32:10.295 INFO:teuthology.orchestra.run.smithi081.stdout:1394 punch from 0x45bc3a9 to 0x45c6969, (0xa5c0 bytes) 2024-09-18T00:32:10.295 INFO:teuthology.orchestra.run.smithi081.stdout:1396 writesame 0x66a7822 thru 0x66a7a5e data_size 0x1(0x23d bytes) 2024-09-18T00:32:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.304 INFO:teuthology.orchestra.run.smithi081.stdout:1398 trunc from 0x9d28b47 to 0x41e5cfa 2024-09-18T00:32:10.317 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:10.317 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:10.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:10.329 INFO:teuthology.orchestra.run.smithi081.stdout:1399 writesame 0x7fa595e thru 0x7fb1122 data_size 0x5(0xb7c5 bytes) 2024-09-18T00:32:10.338 INFO:teuthology.orchestra.run.smithi081.stdout:1401 trunc from 0x7fb1123 to 0x34d034 2024-09-18T00:32:10.383 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:10.382+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:10.456 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:10.456 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:10.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:10.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:10.507 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:10.505+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:10.585 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:10.583+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:10.598 INFO:teuthology.orchestra.run.smithi081.stdout:1403 write 0x59ada7c thru 0x59b782c (0x9db1 bytes) 2024-09-18T00:32:10.611 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.611 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.613 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:10.613 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:10.615 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:10.615 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:10.620 INFO:teuthology.orchestra.run.smithi081.stdout:1407 write 0x8f38581 thru 0x8f3a68f (0x210f bytes) 2024-09-18T00:32:10.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:10.631 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:10.632 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:10.634 INFO:teuthology.orchestra.run.smithi081.stdout:1408 trunc from 0x8f3a690 to 0x73d87da 2024-09-18T00:32:10.645 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.645 INFO:teuthology.orchestra.run.smithi081.stdout:1411 read 0x85c0d5 thru 0x8692ac (0xd1d8 bytes) 2024-09-18T00:32:10.649 INFO:teuthology.orchestra.run.smithi081.stdout:1413 trunc from 0x73d87da to 0x4108ce7 2024-09-18T00:32:10.651 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:1415 punch from 0x26c5675 to 0x26d02cd, (0xac58 bytes) 2024-09-18T00:32:10.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:10.671 INFO:teuthology.orchestra.run.smithi081.stdout:1416 write 0x966766c thru 0x966e14d (0x6ae2 bytes) 2024-09-18T00:32:10.680 INFO:teuthology.orchestra.run.smithi081.stdout:1417 writesame 0x45bc9e5 thru 0x45c8705 data_size 0x1(0xbd21 bytes) 2024-09-18T00:32:10.686 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:10.685+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:10.687 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:10.688 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:10.705 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:10.706 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:10.710 INFO:teuthology.orchestra.run.smithi081.stdout:1419 trunc from 0x966e14e to 0xb692893 2024-09-18T00:32:10.715 INFO:teuthology.orchestra.run.smithi081.stdout:1420 punch from 0xb1578ef to 0xb15f85b, (0x7f6c bytes) 2024-09-18T00:32:10.715 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.715 INFO:teuthology.orchestra.run.smithi081.stdout:1424 writesame 0x8960b14 thru 0x8966c11 data_size 0x41(0x60fe bytes) 2024-09-18T00:32:10.726 INFO:teuthology.orchestra.run.smithi081.stdout:1425 read 0x1105c33 thru 0x110fd03 (0xa0d1 bytes) 2024-09-18T00:32:10.726 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:10.727 INFO:teuthology.orchestra.run.smithi081.stdout:1426 trunc from 0xb692893 to 0xa0e4ed9 2024-09-18T00:32:10.737 INFO:teuthology.orchestra.run.smithi081.stdout:1427 trunc from 0xa0e4ed9 to 0x740badf 2024-09-18T00:32:10.745 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:10.748 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:10.748 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:10.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:10.761 INFO:teuthology.orchestra.run.smithi081.stdout:1429 writesame 0xb44d984 thru 0xb4548f0 data_size 0x23(0x6f6d bytes) 2024-09-18T00:32:10.761 INFO:teuthology.orchestra.run.smithi081.stdout:1430 write 0x45c4639 thru 0x45d2e4b (0xe813 bytes) 2024-09-18T00:32:10.772 INFO:teuthology.orchestra.run.smithi081.stdout:1432 write 0x720b7e0 thru 0x7210a52 (0x5273 bytes) 2024-09-18T00:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout:1433 punch from 0xa8deea0 to 0xa8e9fe0, (0xb140 bytes) 2024-09-18T00:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout:1436 write 0x4969fcc thru 0x4979167 (0xf19c bytes) 2024-09-18T00:32:10.786 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:10.785+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:10.795 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.795 INFO:teuthology.orchestra.run.smithi081.stdout:1438 write 0x44e960c thru 0x44f38b6 (0xa2ab bytes) 2024-09-18T00:32:10.798 INFO:teuthology.orchestra.run.smithi081.stdout:1440 read 0x31f0df2 thru 0x31f1199 (0x3a8 bytes) 2024-09-18T00:32:10.798 INFO:teuthology.orchestra.run.smithi081.stdout:1441 punch from 0x5ee3d63 to 0x5ee5025, (0x12c2 bytes) 2024-09-18T00:32:10.798 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.798 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:10.800 INFO:teuthology.orchestra.run.smithi081.stdout:1447 trunc from 0xb4548f1 to 0x970287b 2024-09-18T00:32:10.806 INFO:teuthology.orchestra.run.smithi081.stdout:1448 read 0x8d73e6 thru 0x8da802 (0x341d bytes) 2024-09-18T00:32:10.806 INFO:teuthology.orchestra.run.smithi081.stdout:1449 write 0x1624520 thru 0x1633a7c (0xf55d bytes) 2024-09-18T00:32:10.820 INFO:teuthology.orchestra.run.smithi081.stdout:1450 punch from 0x5369d8 to 0x540e0d, (0xa435 bytes) 2024-09-18T00:32:10.821 INFO:teuthology.orchestra.run.smithi081.stdout:1451 clone 14 order 19 su 2048 sc 3 2024-09-18T00:32:10.870 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:10.871 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:10.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:10.887 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:10.886+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:10.988 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:10.987+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:11.037 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5129 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070671073, 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028611574000000001, 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5129 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964567+0000", 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0899999999999997e-07 2024-09-18T00:32:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964568+0000", 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8050000000000001e-06 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964577+0000", 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3149999999999992e-06 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964581+0000", 2024-09-18T00:32:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4789999999999998e-06 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993004+0000", 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028422612 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993083+0000", 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9367000000000001e-05 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993178+0000", 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4686999999999997e-05 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5130 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070650744999998, 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029079462, 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5130 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0100000000000001e-07 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964593+0000", 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0809999999999999e-06 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964599+0000", 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9660000000000001e-06 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964603+0000", 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3340000000000003e-06 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993209+0000", 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028605815 2024-09-18T00:32:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993577+0000", 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036788599999999999 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993666+0000", 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9079000000000006e-05 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5168 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 26624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070628588000002, 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02923388, 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5168 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964611+0000", 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6390000000000001e-06 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964616+0000", 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1880000000000001e-06 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964620+0000", 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-18T00:32:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993694+0000", 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029073485 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993763+0000", 2024-09-18T00:32:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9064000000000001e-05 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993843+0000", 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9919999999999994e-05 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5169 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070612063999999, 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029406055, 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5169 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964626+0000", 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964627+0000", 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6649999999999999e-06 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964633+0000", 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964637+0000", 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.189e-06 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993870+0000", 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029233424000000001 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993951+0000", 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1051999999999996e-05 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994031+0000", 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0019999999999996e-05 2024-09-18T00:32:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5170 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 83968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070595668999999, 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029576037999999999, 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5170 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964644+0000", 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5540000000000001e-06 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964650+0000", 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0950000000000001e-06 2024-09-18T00:32:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964654+0000", 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3250000000000001e-06 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994058+0000", 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029403655000000001 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994133+0000", 2024-09-18T00:32:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4974000000000004e-05 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994218+0000", 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5144999999999999e-05 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5171 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070576216999999, 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030497487, 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5171 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964662+0000", 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964663+0000", 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.722e-06 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964672+0000", 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7320000000000004e-06 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964677+0000", 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.527e-06 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994247+0000", 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029570603000000001 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995061+0000", 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00081419399999999996 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995159+0000", 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7380999999999995e-05 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5172 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070555455000001, 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030717230000000002, 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5172 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964691+0000", 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6149999999999997e-06 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964697+0000", 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-18T00:32:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964705+0000", 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0320000000000003e-06 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995209+0000", 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030504452000000001 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995301+0000", 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1367999999999997e-05 2024-09-18T00:32:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995399+0000", 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8340999999999999e-05 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5173 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070526601000001, 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030867024, 2024-09-18T00:32:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5173 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0500000000000004e-07 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964713+0000", 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.84e-06 2024-09-18T00:32:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964719+0000", 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4600000000000002e-06 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964723+0000", 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995429+0000", 2024-09-18T00:32:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030706563999999999 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995500+0000", 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0500999999999995e-05 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995578+0000", 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8035999999999996e-05 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5174 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070509757, 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031034297999999998, 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5174 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964730+0000", 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.655e-06 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964735+0000", 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3940000000000004e-06 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964744+0000", 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995603+0000", 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030859780999999999 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995676+0000", 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2704000000000001e-05 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995762+0000", 2024-09-18T00:32:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5841999999999996e-05 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5175 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070488216000001, 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031208080999999999, 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5175 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964750+0000", 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964751+0000", 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.829e-06 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964757+0000", 2024-09-18T00:32:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3789999999999997e-06 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964761+0000", 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1520000000000002e-06 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995789+0000", 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031028525000000001 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995862+0000", 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2515999999999995e-05 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995957+0000", 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5340000000000005e-05 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5176 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 256000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070471226999999, 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031341039000000001, 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5176 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964767+0000", 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964768+0000", 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6610000000000001e-06 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964774+0000", 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3850000000000001e-06 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964778+0000", 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995985+0000", 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031206289000000002 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996058+0000", 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2974999999999998e-05 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996107+0000", 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9639999999999999e-05 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5177 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 284672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070454058999999, 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031522255999999998, 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5177 2024-09-18T00:32:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964784+0000", 2024-09-18T00:32:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9200000000000002e-07 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964785+0000", 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6869999999999999e-06 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964797+0000", 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1282e-05 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964801+0000", 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5510000000000001e-06 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996136+0000", 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031334870000000001 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996211+0000", 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4475999999999996e-05 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996306+0000", 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5098000000000003e-05 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5178 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 313344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070430632000001, 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031735948, 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5178 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964809+0000", 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7630000000000001e-06 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964819+0000", 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0224000000000001e-05 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964824+0000", 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4139999999999996e-06 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996356+0000", 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031532646999999997 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996446+0000", 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9993000000000004e-05 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996543+0000", 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6576000000000005e-05 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5179 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070407794000001, 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031953505, 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5179 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964837+0000", 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964843+0000", 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.336e-06 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964848+0000", 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4440000000000001e-06 2024-09-18T00:32:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996593+0000", 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031745821 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996680+0000", 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6953000000000006e-05 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996783+0000", 2024-09-18T00:32:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010280000000000001 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5180 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 370688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070383479, 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032134442999999999, 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5180 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964856+0000", 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964862+0000", 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.519e-06 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964866+0000", 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996812+0000", 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031946039000000002 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996899+0000", 2024-09-18T00:32:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7064999999999994e-05 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996988+0000", 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9370999999999995e-05 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5181 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 399360~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070361839, 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.03234393, 2024-09-18T00:32:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5181 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964878+0000", 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.844e-06 2024-09-18T00:32:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964883+0000", 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1100000000000002e-06 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964887+0000", 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9169999999999999e-06 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997032+0000", 2024-09-18T00:32:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032145646 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997116+0000", 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3858999999999998e-05 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997220+0000", 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010323399999999999 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5182 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070345784000001, 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032589419000000001, 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5182 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964894+0000", 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6700000000000001e-06 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964899+0000", 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1080000000000001e-06 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964903+0000", 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8210000000000003e-06 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997297+0000", 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032394065 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997380+0000", 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3226000000000006e-05 2024-09-18T00:32:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997481+0000", 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101048 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5183 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070323272, 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032807066000000003, 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5183 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964921+0000", 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964926+0000", 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964934+0000", 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6809999999999998e-06 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997526+0000", 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032591805000000001 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997617+0000", 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1439000000000003e-05 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997721+0000", 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0001039 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5184 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070297482000001, 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033026119, 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5184 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964942+0000", 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.846e-06 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964948+0000", 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5489999999999997e-06 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964952+0000", 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1060000000000002e-06 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997766+0000", 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032814589999999998 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997863+0000", 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6146999999999999e-05 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997966+0000", 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103454 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5185 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 514048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.070280826000001, 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033245331000000003, 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5185 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9400000000000001e-07 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964958+0000", 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6160000000000001e-06 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964969+0000", 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964974+0000", 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2180000000000001e-06 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998013+0000", 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033038901000000002 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998112+0000", 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9028000000000001e-05 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998202+0000", 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0288e-05 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.128 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:11.128 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:11.128 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-18T00:32:11.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T00:32:11.129 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:11.127+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:11.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone13 from 0x970287b (overlap 0x34d034) to 0x54805 2024-09-18T00:32:11.187 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-18T00:32:11.193 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:11.193 INFO:teuthology.orchestra.run.smithi081.stdout:1454 writesame 0x5ce3a18 thru 0x5ce9774 data_size 0x3(0x5d5d bytes) 2024-09-18T00:32:11.207 INFO:teuthology.orchestra.run.smithi081.stdout:1455 writesame 0x3cbf108 thru 0x3cc489e data_size 0x1(0x5797 bytes) 2024-09-18T00:32:11.229 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:11.227+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:11.230 INFO:teuthology.orchestra.run.smithi081.stdout:1457 trunc from 0x970287b to 0x6888bd2 2024-09-18T00:32:11.247 INFO:teuthology.orchestra.run.smithi081.stdout:1459 trunc from 0x6888bd2 to 0x9f405c5 2024-09-18T00:32:11.254 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:11.254 INFO:teuthology.orchestra.run.smithi081.stdout:1461 read 0x417702c thru 0x417da3d (0x6a12 bytes) 2024-09-18T00:32:11.254 INFO:teuthology.orchestra.run.smithi081.stdout:1462 read 0x90288a7 thru 0x9033bb9 (0xb313 bytes) 2024-09-18T00:32:11.254 INFO:teuthology.orchestra.run.smithi081.stdout:1463 write 0x928d4b4 thru 0x9293aba (0x6607 bytes) 2024-09-18T00:32:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:1465 clone 15 order 20 su 16384 sc 2 2024-09-18T00:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:11.349 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:11.348+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:11.430 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:11.429+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 46, 2024-09-18T00:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "1111294f-f881-4427-a507-2f6f0939f89f", 2024-09-18T00:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-18T00:31:16.967705+0000", 2024-09-18T00:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-18T00:32:10.957340+0000", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-18T00:31:29.069471+0000", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-18T00:31:19.984105+0000", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 6, 2024-09-18T00:32:11.476 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "squid", 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-18T00:32:11.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:29.068996+0000", 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:11.478 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:11.479 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "17", 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-18T00:32:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:11.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-18T00:32:11.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8, 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 8, 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.25, 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-18T00:32:11.484 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:35.737341+0000", 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:11.485 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-18T00:32:11.486 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "21", 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:11.487 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 2, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 21, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:11.488 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:32:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.9900000095367432, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.9900000095367432, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.75, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.75, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-18T00:32:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:45.237398+0000", 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-18T00:32:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "46", 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 16, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 46, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.5, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.5, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.5, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.5, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "f3f5415f-ac86-4dd6-8c50-5391b44b9c6b", 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-18T00:32:11.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6803/2689107883", 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/2689107883", 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6809/2689107883", 2024-09-18T00:32:11.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6807/2689107883", 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "06a47ef1-1ae7-40a2-a998-daac122fc229", 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-18T00:32:11.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6813/1726163291", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6817/1726163291", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6825/1726163291", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6821/1726163291", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.511 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "653ab61a-1037-4190-8806-7042ef3d0586", 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.512 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.513 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 18, 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6812/365910818", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6816/365910818", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6824/365910818", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6820/365910818", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f", 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:11.519 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6832", 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6833", 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:11.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6827/2780316581", 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6829/2780316581", 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6833/2780316581", 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6831/2780316581", 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "7000f249-35b4-4770-8452-8f31064ef1de", 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 32, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6824", 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6825", 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6826", 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6827", 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6830", 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6831", 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6828", 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6829", 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6825/2008948201", 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6827/2008948201", 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6831/2008948201", 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6829/2008948201", 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "755442b3-b418-409d-bd0a-376579eeb381", 2024-09-18T00:32:11.530 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6816", 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6817", 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6818", 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6819", 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6822", 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6823", 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6820", 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6821", 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6817/2331356901", 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6819/2331356901", 2024-09-18T00:32:11.535 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6823/2331356901", 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6821/2331356901", 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6b406b2b-e850-41be-bce8-9f13d2921c60", 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.536 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6800", 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6801", 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6802", 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6803", 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6806", 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6807", 2024-09-18T00:32:11.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6804", 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6805", 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6801/2657673991", 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6803/2657673991", 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6807/2657673991", 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6805/2657673991", 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "8bb8987f-d8e4-494e-82ce-e1203957c35f", 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 38, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:11.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6808", 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6809", 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.544 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6810", 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6811", 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6814", 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6815", 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:11.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6812", 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6813", 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6809/2652298701", 2024-09-18T00:32:11.547 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6811/2652298701", 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6815/2652298701", 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6813/2652298701", 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.548 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.022758+0000", 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.549 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:27.126737+0000", 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.821608+0000", 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.574908+0000", 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.551 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.569036+0000", 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.436338+0000", 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.050552+0000", 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.299077+0000", 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2024-09-18T00:32:11.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-18T00:32:11.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.557 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.559 INFO:tasks.thrashosds.thrasher:j is {'epoch': 46, 'fsid': '1111294f-f881-4427-a507-2f6f0939f89f', 'created': '2024-09-18T00:31:16.967705+0000', 'modified': '2024-09-18T00:32:10.957340+0000', 'last_up_change': '2024-09-18T00:31:29.069471+0000', 'last_in_change': '2024-09-18T00:31:19.984105+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T00:31:29.068996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T00:31:35.737341+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T00:31:45.237398+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 16, 'snap_epoch': 46, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f3f5415f-ac86-4dd6-8c50-5391b44b9c6b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 2689107883}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 2689107883}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 2689107883}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 2689107883}]}, 'public_addr': '172.21.15.81:6803/2689107883', 'cluster_addr': '172.21.15.81:6805/2689107883', 'heartbeat_back_addr': '172.21.15.81:6809/2689107883', 'heartbeat_front_addr': '172.21.15.81:6807/2689107883', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '06a47ef1-1ae7-40a2-a998-daac122fc229', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6811', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1726163291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6815', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6817', 'nonce': 1726163291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 1726163291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6819', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 1726163291}]}, 'public_addr': '172.21.15.81:6813/1726163291', 'cluster_addr': '172.21.15.81:6817/1726163291', 'heartbeat_back_addr': '172.21.15.81:6825/1726163291', 'heartbeat_front_addr': '172.21.15.81:6821/1726163291', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '653ab61a-1037-4190-8806-7042ef3d0586', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6812', 'nonce': 365910818}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6816', 'nonce': 365910818}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 365910818}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6818', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6820', 'nonce': 365910818}]}, 'public_addr': '172.21.15.81:6812/365910818', 'cluster_addr': '172.21.15.81:6816/365910818', 'heartbeat_back_addr': '172.21.15.81:6824/365910818', 'heartbeat_front_addr': '172.21.15.81:6820/365910818', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6827', 'nonce': 2780316581}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6828', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 2780316581}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 2780316581}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 2780316581}]}, 'public_addr': '172.21.15.81:6827/2780316581', 'cluster_addr': '172.21.15.81:6829/2780316581', 'heartbeat_back_addr': '172.21.15.81:6833/2780316581', 'heartbeat_front_addr': '172.21.15.81:6831/2780316581', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7000f249-35b4-4770-8452-8f31064ef1de', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6824', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6825', 'nonce': 2008948201}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6826', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6827', 'nonce': 2008948201}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6830', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6831', 'nonce': 2008948201}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6828', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6829', 'nonce': 2008948201}]}, 'public_addr': '172.21.15.167:6825/2008948201', 'cluster_addr': '172.21.15.167:6827/2008948201', 'heartbeat_back_addr': '172.21.15.167:6831/2008948201', 'heartbeat_front_addr': '172.21.15.167:6829/2008948201', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '755442b3-b418-409d-bd0a-376579eeb381', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6816', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6817', 'nonce': 2331356901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6818', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6819', 'nonce': 2331356901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6822', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6823', 'nonce': 2331356901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6820', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6821', 'nonce': 2331356901}]}, 'public_addr': '172.21.15.167:6817/2331356901', 'cluster_addr': '172.21.15.167:6819/2331356901', 'heartbeat_back_addr': '172.21.15.167:6823/2331356901', 'heartbeat_front_addr': '172.21.15.167:6821/2331356901', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6b406b2b-e850-41be-bce8-9f13d2921c60', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6800', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6801', 'nonce': 2657673991}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6802', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6803', 'nonce': 2657673991}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6806', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6807', 'nonce': 2657673991}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6804', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6805', 'nonce': 2657673991}]}, 'public_addr': '172.21.15.167:6801/2657673991', 'cluster_addr': '172.21.15.167:6803/2657673991', 'heartbeat_back_addr': '172.21.15.167:6807/2657673991', 'heartbeat_front_addr': '172.21.15.167:6805/2657673991', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '8bb8987f-d8e4-494e-82ce-e1203957c35f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6808', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6809', 'nonce': 2652298701}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6810', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6811', 'nonce': 2652298701}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6814', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6815', 'nonce': 2652298701}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6812', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6813', 'nonce': 2652298701}]}, 'public_addr': '172.21.15.167:6809/2652298701', 'cluster_addr': '172.21.15.167:6811/2652298701', 'heartbeat_back_addr': '172.21.15.167:6815/2652298701', 'heartbeat_front_addr': '172.21.15.167:6813/2652298701', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.022758+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:27.126737+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.821608+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.574908+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.569036+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.436338+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.050552+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.299077+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T00:32:11.559 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-18T00:32:11.559 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:11.556+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13026 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28901376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.432340153, 2024-09-18T00:32:11.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011453733000000001, 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13026 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:11.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130804+0000", 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1299999999999999e-07 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130805+0000", 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.136e-06 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130808+0000", 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9450000000000002e-06 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130811+0000", 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6350000000000002e-06 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142149+0000", 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01133849 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142201+0000", 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1691999999999999e-05 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142258+0000", 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6622000000000001e-05 2024-09-18T00:32:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13027 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29687808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130814+0000", 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.432329756, 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011578432, 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13027 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130814+0000", 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130814+0000", 2024-09-18T00:32:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130815+0000", 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.96e-07 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130816+0000", 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.517e-06 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130821+0000", 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130825+0000", 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1659999999999996e-06 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142283+0000", 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0114579 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142325+0000", 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2073000000000002e-05 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142393+0000", 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7533999999999994e-05 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13028 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 30474240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.432301375, 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011662717, 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13028 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130843+0000", 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1799999999999995e-07 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130845+0000", 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.046e-06 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130851+0000", 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130855+0000", 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4669999999999998e-06 2024-09-18T00:32:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142420+0000", 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011564928 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142459+0000", 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9159999999999998e-05 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142505+0000", 2024-09-18T00:32:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5878999999999999e-05 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13029 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 31260672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.130864+0000", 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.432279821, 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011799693, 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13029 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130864+0000", 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130864+0000", 2024-09-18T00:32:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130865+0000", 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9700000000000002e-07 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130867+0000", 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1019999999999999e-06 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130877+0000", 2024-09-18T00:32:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0339999999999999e-05 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.130882+0000", 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8149999999999996e-06 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142531+0000", 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011649267 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142597+0000", 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5804999999999998e-05 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142664+0000", 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6966999999999998e-05 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13054 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 25821184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131134+0000", 2024-09-18T00:32:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.432009838999999, 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011644855000000001, 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13054 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131134+0000", 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131134+0000", 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131135+0000", 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4300000000000001e-07 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131140+0000", 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0599999999999998e-06 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131156+0000", 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5679999999999999e-05 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131164+0000", 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6839999999999996e-06 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142688+0000", 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011524895 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142728+0000", 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9875e-05 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142779+0000", 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0717999999999998e-05 2024-09-18T00:32:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13055 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 26607616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131176+0000", 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431967813, 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011734448, 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13055 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131176+0000", 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131176+0000", 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131177+0000", 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7999999999999996e-07 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131179+0000", 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5220000000000002e-06 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131187+0000", 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5719999999999997e-06 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131194+0000", 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1799999999999999e-06 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142807+0000", 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011612577000000001 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142851+0000", 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4286000000000003e-05 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142911+0000", 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9830999999999997e-05 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13056 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 27394048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131215+0000", 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431929017, 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011828554, 2024-09-18T00:32:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13056 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131215+0000", 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131215+0000", 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131216+0000", 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3399999999999999e-07 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131218+0000", 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:32:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131226+0000", 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131232+0000", 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142937+0000", 2024-09-18T00:32:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011705278 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.142980+0000", 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2781999999999998e-05 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143044+0000", 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3399999999999996e-05 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13057 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28180480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131240+0000", 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431903641, 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011995570000000001, 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13057 2024-09-18T00:32:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131240+0000", 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131240+0000", 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131241+0000", 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131243+0000", 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.99e-06 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131252+0000", 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9870000000000005e-06 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131258+0000", 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143087+0000", 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011829162000000001 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143161+0000", 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3782000000000006e-05 2024-09-18T00:32:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143236+0000", 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4727999999999993e-05 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13058 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28966912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431879152, 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012156356, 2024-09-18T00:32:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13058 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131265+0000", 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8799999999999998e-07 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131267+0000", 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.956e-06 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131273+0000", 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1539999999999999e-06 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131278+0000", 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.87e-06 2024-09-18T00:32:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143280+0000", 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012001357000000001 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143346+0000", 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6618000000000005e-05 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143421+0000", 2024-09-18T00:32:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5012999999999995e-05 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13059 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29753344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431859211999999, 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012304376000000001, 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13059 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131285+0000", 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131288+0000", 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8710000000000001e-06 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131295+0000", 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4100000000000002e-06 2024-09-18T00:32:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131301+0000", 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4110000000000004e-06 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143449+0000", 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012148096000000001 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143506+0000", 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:32:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143589+0000", 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3234999999999998e-05 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13060 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 30539776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431836972999999, 2024-09-18T00:32:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012436137999999999, 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13060 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131307+0000", 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131309+0000", 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.875e-06 2024-09-18T00:32:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131315+0000", 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0900000000000001e-06 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131320+0000", 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1150000000000002e-06 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143614+0000", 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012293024 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143671+0000", 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7200999999999997e-05 2024-09-18T00:32:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143743+0000", 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2463000000000001e-05 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13061 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 31326208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131326+0000", 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431817764, 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012591569, 2024-09-18T00:32:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13061 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131326+0000", 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131326+0000", 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131327+0000", 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5100000000000001e-07 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131328+0000", 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8419999999999999e-06 2024-09-18T00:32:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131334+0000", 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4349999999999996e-06 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131338+0000", 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3760000000000001e-06 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143778+0000", 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012439317 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143843+0000", 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5845000000000004e-05 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143918+0000", 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4402999999999999e-05 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13086 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 25886720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131478+0000", 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431665567, 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012587889999999999, 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13086 2024-09-18T00:32:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131478+0000", 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131478+0000", 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131479+0000", 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6400000000000001e-07 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131483+0000", 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6859999999999999e-06 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131493+0000", 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7189999999999996e-06 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131504+0000", 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1279e-05 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.143958+0000", 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012454174 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144012+0000", 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3919999999999999e-05 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144066+0000", 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4348000000000002e-05 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13087 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 26673152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131514+0000", 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431629835000001, 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012688687000000001, 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13087 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131514+0000", 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131514+0000", 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131515+0000", 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6899999999999998e-07 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131518+0000", 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.269e-06 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131525+0000", 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6919999999999996e-06 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131530+0000", 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1089999999999997e-06 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144101+0000", 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012571018 2024-09-18T00:32:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144151+0000", 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0379e-05 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144203+0000", 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1751e-05 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13088 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 27459584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131554+0000", 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431589685000001, 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012781377999999999, 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13088 2024-09-18T00:32:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131554+0000", 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131554+0000", 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131555+0000", 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8800000000000002e-07 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131557+0000", 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2680000000000001e-06 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131565+0000", 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5730000000000002e-06 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131570+0000", 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.276e-06 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144233+0000", 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012663232999999999 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144282+0000", 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8378000000000003e-05 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144336+0000", 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4061999999999998e-05 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13089 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 28246016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431554168, 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012888778, 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13089 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131590+0000", 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.82e-07 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131593+0000", 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.542e-06 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131600+0000", 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2309999999999999e-06 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131605+0000", 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.203e-06 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144375+0000", 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01276975 2024-09-18T00:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144419+0000", 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4088000000000002e-05 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144479+0000", 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9382000000000002e-05 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13090 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29032448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.43153148, 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013068735, 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13090 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131613+0000", 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131615+0000", 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9139999999999998e-06 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131622+0000", 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7560000000000002e-06 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131630+0000", 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7329999999999992e-06 2024-09-18T00:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144519+0000", 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012889147 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144602+0000", 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2424999999999998e-05 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144681+0000", 2024-09-18T00:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9379e-05 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13091 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 29818880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431505291000001, 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013222229, 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13091 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131639+0000", 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9299999999999999e-07 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131641+0000", 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8679999999999999e-06 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131649+0000", 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.79e-06 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131653+0000", 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6500000000000004e-06 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144709+0000", 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013055832 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144768+0000", 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8591000000000002e-05 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144861+0000", 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3104999999999997e-05 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13092 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 30605312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431484859999999, 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013375326, 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13092 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131659+0000", 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5600000000000001e-07 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131661+0000", 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9829999999999999e-06 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131668+0000", 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0460000000000002e-06 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131674+0000", 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1489999999999999e-06 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144911+0000", 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013237034999999999 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.144971+0000", 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0044000000000003e-05 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145034+0000", 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3713000000000005e-05 2024-09-18T00:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:13093 3.4 3:2584daa4:::rbd_data.1197fe10a2f8.0000000000000003:8 [sparse-read 31391744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.431457482000001, 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013486318000000001, 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 13093 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131687+0000", 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1500000000000005e-07 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131689+0000", 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131695+0000", 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2589999999999997e-06 2024-09-18T00:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.131700+0000", 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7249999999999997e-06 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145056+0000", 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013356178 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145105+0000", 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9023000000000001e-05 2024-09-18T00:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:59.145173+0000", 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7521000000000006e-05 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:11.698 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:11.696+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:11.760 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:11.758+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:11.800 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:11.800 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:11.860 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:11.859+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:11.910 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:11.910 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:11.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:11.964 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:11.963+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:11.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:32:12.032 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:32:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.494377738000001, 2024-09-18T00:32:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:32:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:32:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:32:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.349991282000001, 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:32:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:32:12.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.324674453, 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:32:12.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:4461 3.0 e30/23 3:0295e385:::rbd_data.1197f1330e07.0000000000000158:head v 30'16, mlcod=29'14)", 2024-09-18T00:32:12.052 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.042912814000001, 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031733740000000001, 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986614+0000", 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986615+0000", 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.359e-06 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986626+0000", 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1136e-05 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986643+0000", 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986653+0000", 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9979999999999998e-06 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986718+0000", 2024-09-18T00:32:12.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4527000000000001e-05 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.986739+0000", 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0953000000000001e-05 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989736+0000", 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029969340000000001 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.989787+0000", 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1598999999999998e-05 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:15867 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'43, mlcod=39'40)", 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.5798596249999992, 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036878850000000001, 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449668+0000", 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9999999999999997e-07 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449673+0000", 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0950000000000003e-06 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449685+0000", 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2313999999999999e-05 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449691+0000", 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2770000000000002e-06 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449733+0000", 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2131e-05 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449752+0000", 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8987999999999998e-05 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453326+0000", 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035735290000000002 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453355+0000", 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8951000000000001e-05 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.0 epoch 39/23 rep_tid 145 entries 39'38 (0'0) error 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head by client.4503.0:15920 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 39'35)", 2024-09-18T00:32:12.061 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.499941+0000", 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.5295855960000004, 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031554180000000001, 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.499941+0000", 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.499941+0000", 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.499941+0000", 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.53e-07 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.499948+0000", 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4840000000000001e-06 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.499961+0000", 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2831e-05 2024-09-18T00:32:12.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.499972+0000", 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1012999999999999e-05 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.500046+0000", 2024-09-18T00:32:12.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3892000000000003e-05 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.503097+0000", 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030508449999999999 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:12.065 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2008100339999999, 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:12.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:32:12.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16281 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'55, mlcod=39'52)", 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2002353130000003, 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034366890000000001, 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829292+0000", 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9800000000000003e-07 2024-09-18T00:32:12.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829297+0000", 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2449999999999998e-06 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829310+0000", 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2649999999999999e-05 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829317+0000", 2024-09-18T00:32:12.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8669999999999996e-06 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829366+0000", 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9604000000000001e-05 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829384+0000", 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7445e-05 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832703+0000", 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033195400000000002 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832728+0000", 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4640000000000001e-05 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16279 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'68, mlcod=39'65)", 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2001771699999999, 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033756509999999999, 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829354+0000", 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2069999999999997e-06 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829363+0000", 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4209999999999995e-06 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829368+0000", 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4909999999999996e-06 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829413+0000", 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4830000000000003e-05 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829430+0000", 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7221e-05 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832693+0000", 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003262764 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832725+0000", 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2298000000000001e-05 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:32:12.080 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.1221013479999993, 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:32:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.1219450630000001, 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.1217607390000008, 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:32:12.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:32:12.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.4 epoch 39/23 rep_tid 240 entries 39'95 (0'0) error 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head by client.4503.0:16773 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 39'93)", 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:03.439294+0000", 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5902325430000008, 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030817900000000001, 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-18T00:32:12.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439294+0000", 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439294+0000", 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439295+0000", 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:12.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439301+0000", 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7909999999999999e-06 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439314+0000", 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2779000000000001e-05 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439325+0000", 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0797e-05 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.439390+0000", 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4869000000000005e-05 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:03.442376+0000", 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029860939999999999 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.0036423860000001, 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:32:12.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:32:12.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8454689640000002, 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:32:12.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:32:12.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:32:12.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8444910299999999, 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:32:12.106 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:32:12.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:32:12.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8437644180000001, 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:32:12.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:32:12.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.95991765299999998, 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:12.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.95887576299999999, 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.95385107599999996, 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:32:12.124 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:32:12.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:32:12.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.129 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:12.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:12.131 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone14 from 0x9f405c5 (overlap 0x6888bd2) to 0x0 2024-09-18T00:32:12.131 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:12.128+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:12.231 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:12.230+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:12.305 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35665 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271185+0000", 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012133751999999999, 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012154366, 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35665 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271185+0000", 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271185+0000", 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271186+0000", 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271188+0000", 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2879999999999999e-06 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271194+0000", 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8719999999999999e-06 2024-09-18T00:32:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271199+0000", 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.51e-06 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35697 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271808+0000", 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011511665000000001, 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011605048999999999, 2024-09-18T00:32:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35697 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271808+0000", 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271808+0000", 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271808+0000", 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6699999999999999e-07 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271813+0000", 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-18T00:32:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271819+0000", 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.891e-06 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271823+0000", 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4299999999999999e-06 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35729 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272452+0000", 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010867488999999999, 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011026241000000001, 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35729 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272452+0000", 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272452+0000", 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272452+0000", 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:32:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272454+0000", 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6589999999999999e-06 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272459+0000", 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6710000000000004e-06 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272464+0000", 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35761 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273062+0000", 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.01025772, 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010474209999999999, 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35761 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273062+0000", 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273062+0000", 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273062+0000", 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7500000000000001e-07 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273064+0000", 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.719e-06 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273069+0000", 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5090000000000001e-06 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273074+0000", 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6430000000000003e-06 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36179 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279058+0000", 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0042608940000000003, 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045302930000000003, 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36179 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279058+0000", 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279058+0000", 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279059+0000", 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279061+0000", 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1799999999999999e-06 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279067+0000", 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6860000000000003e-06 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279071+0000", 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6979999999999997e-06 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36211 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280419+0000", 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0029001740000000002, 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003226891, 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36211 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280419+0000", 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280419+0000", 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280420+0000", 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6700000000000003e-07 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280433+0000", 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3799e-05 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280442+0000", 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3650000000000004e-06 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280448+0000", 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1099999999999999e-06 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36243 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282386+0000", 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00093309800000000004, 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001312489, 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36243 2024-09-18T00:32:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282386+0000", 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282386+0000", 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282387+0000", 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282391+0000", 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8849999999999998e-06 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282397+0000", 2024-09-18T00:32:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8560000000000003e-06 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282402+0000", 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6240000000000001e-06 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35666 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271205+0000", 2024-09-18T00:32:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012114073, 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012548449, 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35666 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271205+0000", 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271205+0000", 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271206+0000", 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271208+0000", 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9989999999999998e-06 2024-09-18T00:32:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271213+0000", 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271218+0000", 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35698 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271829+0000", 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011490225999999999, 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011979319, 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35698 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271829+0000", 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271829+0000", 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271829+0000", 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271831+0000", 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271837+0000", 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6210000000000001e-06 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271841+0000", 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4320000000000001e-06 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35730 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272469+0000", 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010850256000000001, 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011394883, 2024-09-18T00:32:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35730 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272469+0000", 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272469+0000", 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272469+0000", 2024-09-18T00:32:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4700000000000002e-07 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272471+0000", 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8419999999999999e-06 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272477+0000", 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7300000000000002e-06 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272481+0000", 2024-09-18T00:32:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5129999999999998e-06 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35762 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273079+0000", 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010240361, 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010843728, 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35762 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273079+0000", 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273079+0000", 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273079+0000", 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5100000000000001e-07 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273081+0000", 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7320000000000001e-06 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273087+0000", 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273091+0000", 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4669999999999998e-06 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36180 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279077+0000", 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0042422040000000003, 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048988950000000003, 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36180 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279077+0000", 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279077+0000", 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279077+0000", 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2399999999999999e-07 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279079+0000", 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.075e-06 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279085+0000", 2024-09-18T00:32:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6710000000000004e-06 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279090+0000", 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4700000000000004e-06 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36212 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280456+0000", 2024-09-18T00:32:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.002863244, 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035713289999999998, 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36212 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280456+0000", 2024-09-18T00:32:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280456+0000", 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280457+0000", 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2799999999999996e-07 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280460+0000", 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3380000000000001e-06 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280508+0000", 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8282999999999998e-05 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280514+0000", 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36244 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282415+0000", 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00090461800000000005, 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016654949999999999, 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36244 2024-09-18T00:32:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282415+0000", 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282415+0000", 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282415+0000", 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.96e-07 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282417+0000", 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.204e-06 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282423+0000", 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1859999999999997e-06 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282428+0000", 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9389999999999996e-06 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35667 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271223+0000", 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012095954000000001, 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012913002999999999, 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35667 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271223+0000", 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271223+0000", 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271224+0000", 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271225+0000", 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271231+0000", 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9549999999999997e-06 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271236+0000", 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5800000000000002e-06 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35699 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271862+0000", 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011457055000000001, 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012326665000000001, 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35699 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271862+0000", 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271862+0000", 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271863+0000", 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.46e-07 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271865+0000", 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0930000000000001e-06 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271878+0000", 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3220999999999999e-05 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271883+0000", 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35731 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272487+0000", 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010832309, 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011754017, 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35731 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272487+0000", 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272487+0000", 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272487+0000", 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3500000000000002e-07 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272489+0000", 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.798e-06 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272496+0000", 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7209999999999997e-06 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272501+0000", 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0590000000000002e-06 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35763 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273098+0000", 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.01022143, 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011200649999999999, 2024-09-18T00:32:12.364 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35763 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273098+0000", 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273098+0000", 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273098+0000", 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2300000000000002e-07 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273100+0000", 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7579999999999999e-06 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273106+0000", 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6699999999999999e-06 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273110+0000", 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5329999999999996e-06 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36181 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279095+0000", 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0042238390000000001, 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057745080000000002, 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36181 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279095+0000", 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279095+0000", 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279096+0000", 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2300000000000002e-07 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279098+0000", 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0700000000000001e-06 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279103+0000", 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5060000000000003e-06 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279108+0000", 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5669999999999996e-06 2024-09-18T00:32:12.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36213 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280524+0000", 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0027954210000000002, 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044088260000000002, 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36213 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280524+0000", 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280524+0000", 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280524+0000", 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8400000000000004e-07 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280527+0000", 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8459999999999999e-06 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280533+0000", 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9660000000000001e-06 2024-09-18T00:32:12.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280538+0000", 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4549999999999997e-06 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36245 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282435+0000", 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00088473700000000002, 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002551223, 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36245 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282435+0000", 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282435+0000", 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282435+0000", 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9400000000000001e-07 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282437+0000", 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.984e-06 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282443+0000", 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9750000000000004e-06 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282447+0000", 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3800000000000004e-06 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35668 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271241+0000", 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012077753, 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013801897, 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35668 2024-09-18T00:32:12.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271241+0000", 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271241+0000", 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271242+0000", 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1399999999999998e-07 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271246+0000", 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271252+0000", 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1709999999999999e-06 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271257+0000", 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5619999999999997e-06 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35700 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271890+0000", 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011429126, 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013206816, 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35700 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271890+0000", 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271890+0000", 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271891+0000", 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.08e-07 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271895+0000", 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.369e-06 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271905+0000", 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0441999999999999e-05 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271911+0000", 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9939999999999997e-06 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35732 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.384 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272506+0000", 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010812978000000001, 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012644341, 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35732 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272506+0000", 2024-09-18T00:32:12.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272506+0000", 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272507+0000", 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272509+0000", 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3020000000000002e-06 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272514+0000", 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4979999999999997e-06 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272519+0000", 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5589999999999999e-06 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35764 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273115+0000", 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010203851, 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012088253, 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35764 2024-09-18T00:32:12.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273115+0000", 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273115+0000", 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273116+0000", 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273119+0000", 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.785e-06 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273124+0000", 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7100000000000004e-06 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273129+0000", 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5639999999999998e-06 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36182 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279745+0000", 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035742349999999998, 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055124650000000002, 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36182 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279745+0000", 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279745+0000", 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279746+0000", 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279749+0000", 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7450000000000001e-06 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279758+0000", 2024-09-18T00:32:12.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5660000000000007e-06 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279764+0000", 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1140000000000002e-06 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36214 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280544+0000", 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0027753209999999999, 2024-09-18T00:32:12.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047661819999999999, 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36214 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280544+0000", 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280544+0000", 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280544+0000", 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.96e-07 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280546+0000", 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.841e-06 2024-09-18T00:32:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280552+0000", 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8089999999999998e-06 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280557+0000", 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5879999999999999e-06 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36246 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282453+0000", 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000866674, 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029107730000000002, 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36246 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282453+0000", 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282453+0000", 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282453+0000", 2024-09-18T00:32:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282455+0000", 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8309999999999999e-06 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282460+0000", 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282465+0000", 2024-09-18T00:32:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5050000000000001e-06 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35669 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271263+0000", 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012056542, 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014160765000000001, 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35669 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271263+0000", 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271263+0000", 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271263+0000", 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5600000000000001e-07 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271265+0000", 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9420000000000002e-06 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271271+0000", 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9209999999999997e-06 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271276+0000", 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8500000000000002e-06 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35701 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271919+0000", 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011400464000000001, 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013557589, 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35701 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271919+0000", 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271919+0000", 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271919+0000", 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271921+0000", 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1940000000000001e-06 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271928+0000", 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2759999999999997e-06 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271932+0000", 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7720000000000002e-06 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35733 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272537+0000", 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010781747, 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012997131, 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35733 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272537+0000", 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272537+0000", 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272538+0000", 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3599999999999999e-07 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272543+0000", 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9400000000000001e-06 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272549+0000", 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4819999999999999e-06 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272554+0000", 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8779999999999997e-06 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35765 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273134+0000", 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010184949, 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012453295, 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35765 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273134+0000", 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273134+0000", 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273135+0000", 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273136+0000", 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.595e-06 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273142+0000", 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6500000000000001e-06 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273146+0000", 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1540000000000004e-06 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36183 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279793+0000", 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035260410000000002, 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058504639999999997, 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36183 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279793+0000", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279793+0000", 2024-09-18T00:32:12.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279794+0000", 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2900000000000004e-07 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279796+0000", 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279803+0000", 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.241e-06 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279808+0000", 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1320000000000002e-06 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36215 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.417 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280562+0000", 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0027569259999999998, 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051336960000000001, 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36215 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280562+0000", 2024-09-18T00:32:12.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280562+0000", 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280563+0000", 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280564+0000", 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5859999999999999e-06 2024-09-18T00:32:12.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280570+0000", 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8869999999999997e-06 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280575+0000", 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5940000000000004e-06 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36247 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.420 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282471+0000", 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00084868200000000002, 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003302405, 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36247 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282471+0000", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282471+0000", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282471+0000", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282476+0000", 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282482+0000", 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0990000000000004e-06 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282487+0000", 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6369999999999998e-06 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35670 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271281+0000", 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012037922, 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014551461999999999, 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35670 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271281+0000", 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271281+0000", 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271282+0000", 2024-09-18T00:32:12.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271283+0000", 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6390000000000001e-06 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271288+0000", 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1599999999999997e-06 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271293+0000", 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8289999999999998e-06 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35702 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271938+0000", 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011381496, 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014734967999999999, 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35702 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271938+0000", 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271938+0000", 2024-09-18T00:32:12.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271938+0000", 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3700000000000001e-07 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271940+0000", 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9209999999999999e-06 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271946+0000", 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9190000000000004e-06 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271951+0000", 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6410000000000001e-06 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35734 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272561+0000", 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010758208999999999, 2024-09-18T00:32:12.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014177769, 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35734 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272561+0000", 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272561+0000", 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272561+0000", 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1100000000000001e-07 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272563+0000", 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7910000000000001e-06 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272569+0000", 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7200000000000003e-06 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272574+0000", 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5789999999999997e-06 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.433 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35766 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273151+0000", 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010167812, 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013643044999999999, 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35766 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273151+0000", 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273151+0000", 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273152+0000", 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5100000000000001e-07 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273153+0000", 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7129999999999999e-06 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273159+0000", 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273164+0000", 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3680000000000004e-06 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36184 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279816+0000", 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035035550000000002, 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070362039999999999, 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36184 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279816+0000", 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279816+0000", 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279816+0000", 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2300000000000002e-07 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279818+0000", 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3099999999999999e-06 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279824+0000", 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9290000000000003e-06 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279829+0000", 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8189999999999999e-06 2024-09-18T00:32:12.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36216 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280580+0000", 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0027391099999999999, 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063315740000000004, 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36216 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280580+0000", 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280580+0000", 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280581+0000", 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000002e-07 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280582+0000", 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7379999999999999e-06 2024-09-18T00:32:12.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280588+0000", 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.818e-06 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280593+0000", 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5809999999999998e-06 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36248 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282492+0000", 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00082697000000000001, 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044774699999999999, 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36248 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282492+0000", 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282492+0000", 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282493+0000", 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282495+0000", 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8509999999999999e-06 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282501+0000", 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1349999999999997e-06 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282513+0000", 2024-09-18T00:32:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.225e-05 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35671 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271299+0000", 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.012020322999999999, 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015728177999999999, 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35671 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271299+0000", 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271299+0000", 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271299+0000", 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.39e-07 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271301+0000", 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9089999999999998e-06 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271307+0000", 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6760000000000004e-06 2024-09-18T00:32:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271311+0000", 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35703 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271957+0000", 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011362644999999999, 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015128610000000001, 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35703 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271957+0000", 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271957+0000", 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271957+0000", 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271959+0000", 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9870000000000002e-06 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271965+0000", 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.964e-06 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271969+0000", 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3279999999999999e-06 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35735 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272579+0000", 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010740181999999999, 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014559961999999999, 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35735 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272579+0000", 2024-09-18T00:32:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272579+0000", 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272579+0000", 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272581+0000", 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7320000000000001e-06 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272587+0000", 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7989999999999999e-06 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272591+0000", 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3970000000000004e-06 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35767 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273169+0000", 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010150328, 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014024437000000001, 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35767 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273169+0000", 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273169+0000", 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273169+0000", 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.67e-07 2024-09-18T00:32:12.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273171+0000", 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7290000000000001e-06 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273176+0000", 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.57e-06 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273181+0000", 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4920000000000004e-06 2024-09-18T00:32:12.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36185 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279835+0000", 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0034845060000000001, 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074111489999999997, 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36185 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279835+0000", 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279835+0000", 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279835+0000", 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279839+0000", 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.16e-06 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279846+0000", 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:12.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279850+0000", 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6759999999999998e-06 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36217 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280598+0000", 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0027212389999999999, 2024-09-18T00:32:12.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0067048120000000001, 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36217 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280598+0000", 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280598+0000", 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280598+0000", 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280600+0000", 2024-09-18T00:32:12.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.827e-06 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280606+0000", 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7729999999999996e-06 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280612+0000", 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36249 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282521+0000", 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00079819099999999996, 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050879319999999999, 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36249 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282521+0000", 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282521+0000", 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282522+0000", 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4799999999999998e-07 2024-09-18T00:32:12.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282524+0000", 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0870000000000001e-06 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282530+0000", 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3330000000000002e-06 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282535+0000", 2024-09-18T00:32:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5480000000000003e-06 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35672 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271317+0000", 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.01200273, 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016357403999999999, 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35672 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271317+0000", 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271317+0000", 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271317+0000", 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1399999999999998e-07 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271318+0000", 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.61e-06 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271325+0000", 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5710000000000003e-06 2024-09-18T00:32:12.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271331+0000", 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5559999999999998e-06 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35704 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271975+0000", 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011344365, 2024-09-18T00:32:12.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0157541, 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35704 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271975+0000", 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271975+0000", 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271975+0000", 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.27e-07 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271977+0000", 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9700000000000002e-06 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271983+0000", 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9190000000000004e-06 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271988+0000", 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4120000000000003e-06 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35736 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272597+0000", 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010722730999999999, 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015186678, 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35736 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272597+0000", 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272597+0000", 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272597+0000", 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5400000000000002e-07 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272600+0000", 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272606+0000", 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.268e-06 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272610+0000", 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3050000000000003e-06 2024-09-18T00:32:12.480 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35768 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273186+0000", 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010132883000000001, 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014654689, 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.481 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35768 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273186+0000", 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273186+0000", 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273187+0000", 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.27e-07 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273189+0000", 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.869e-06 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273194+0000", 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.378e-06 2024-09-18T00:32:12.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273199+0000", 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6700000000000002e-06 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36186 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279857+0000", 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003462672, 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080416280000000003, 2024-09-18T00:32:12.484 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36186 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279857+0000", 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279857+0000", 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279857+0000", 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.58e-07 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279859+0000", 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8679999999999999e-06 2024-09-18T00:32:12.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279865+0000", 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8170000000000004e-06 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279869+0000", 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5510000000000001e-06 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36218 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280618+0000", 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0027011029999999998, 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073376049999999996, 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36218 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280618+0000", 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280618+0000", 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280619+0000", 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0499999999999999e-07 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280620+0000", 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.827e-06 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280626+0000", 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1249999999999998e-06 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280631+0000", 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4059999999999998e-06 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36250 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282540+0000", 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00077920300000000001, 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054697219999999998, 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36250 2024-09-18T00:32:12.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282540+0000", 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282540+0000", 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282541+0000", 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6400000000000003e-07 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282542+0000", 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.933e-06 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282548+0000", 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9460000000000003e-06 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282553+0000", 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4950000000000002e-06 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35673 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271336+0000", 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011982783, 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016729419999999998, 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35673 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271336+0000", 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271336+0000", 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271337+0000", 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271342+0000", 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2079999999999999e-06 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271348+0000", 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.28e-06 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271353+0000", 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.497 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35705 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271993+0000", 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0113265, 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016126755999999999, 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35705 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271993+0000", 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271993+0000", 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271993+0000", 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271995+0000", 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8050000000000001e-06 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272001+0000", 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272005+0000", 2024-09-18T00:32:12.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3499999999999999e-06 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35737 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272616+0000", 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010703483, 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015560434, 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35737 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272616+0000", 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272616+0000", 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272616+0000", 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9700000000000002e-07 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272618+0000", 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7179999999999999e-06 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272624+0000", 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:12.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272629+0000", 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35769 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273206+0000", 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010113530000000001, 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01502439, 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35769 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273206+0000", 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273206+0000", 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273206+0000", 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000002e-07 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273212+0000", 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4539999999999998e-06 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273217+0000", 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8139999999999997e-06 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273222+0000", 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5419999999999999e-06 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36187 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279883+0000", 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0034366589999999999, 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084039530000000005, 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36187 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279883+0000", 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279883+0000", 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279883+0000", 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279889+0000", 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5509999999999999e-06 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279895+0000", 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.981e-06 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279900+0000", 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0900000000000004e-06 2024-09-18T00:32:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36219 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280645+0000", 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0026737879999999999, 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076946860000000001, 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36219 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280645+0000", 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280645+0000", 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280646+0000", 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7800000000000002e-07 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280648+0000", 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280656+0000", 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3749999999999997e-06 2024-09-18T00:32:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280661+0000", 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0289999999999996e-06 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36251 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282559+0000", 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00076009600000000004, 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058406980000000001, 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36251 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282559+0000", 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282559+0000", 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282560+0000", 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282563+0000", 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3069999999999998e-06 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282568+0000", 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.626e-06 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282578+0000", 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9650000000000003e-06 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35674 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271360+0000", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011959736, 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096299999999998, 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35674 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271360+0000", 2024-09-18T00:32:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271360+0000", 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271360+0000", 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271362+0000", 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8390000000000001e-06 2024-09-18T00:32:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271367+0000", 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3449999999999996e-06 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271372+0000", 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7469999999999996e-06 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35706 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272013+0000", 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.01130666, 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016498909999999999, 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35706 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272013+0000", 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272013+0000", 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272013+0000", 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.41e-07 2024-09-18T00:32:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272015+0000", 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9190000000000002e-06 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272020+0000", 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3809999999999998e-06 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272025+0000", 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5179999999999998e-06 2024-09-18T00:32:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35738 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272635+0000", 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010683761, 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015930133999999999, 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35738 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272635+0000", 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272635+0000", 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272636+0000", 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272638+0000", 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7680000000000001e-06 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272643+0000", 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-06 2024-09-18T00:32:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272648+0000", 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5279999999999997e-06 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35770 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273228+0000", 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010090929, 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015392944, 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35770 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273228+0000", 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273228+0000", 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273229+0000", 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273230+0000", 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8109999999999999e-06 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273236+0000", 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273241+0000", 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4360000000000004e-06 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36188 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279907+0000", 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0034123550000000002, 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087681579999999999, 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36188 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279907+0000", 2024-09-18T00:32:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279907+0000", 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279907+0000", 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6699999999999999e-07 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279909+0000", 2024-09-18T00:32:12.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.012e-06 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279915+0000", 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9120000000000003e-06 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279920+0000", 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4139999999999996e-06 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36220 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280672+0000", 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0026470320000000001, 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080552090000000007, 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36220 2024-09-18T00:32:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280672+0000", 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280672+0000", 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280673+0000", 2024-09-18T00:32:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3000000000000001e-07 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280675+0000", 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280681+0000", 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9089999999999997e-06 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280686+0000", 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5910000000000003e-06 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36252 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282585+0000", 2024-09-18T00:32:12.537 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00073386299999999996, 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062233230000000002, 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36252 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282585+0000", 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282585+0000", 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282586+0000", 2024-09-18T00:32:12.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282589+0000", 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8930000000000001e-06 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282600+0000", 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1647999999999999e-05 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282605+0000", 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8930000000000004e-06 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35675 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271377+0000", 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011941854, 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017488100999999999, 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35675 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271377+0000", 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271377+0000", 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271378+0000", 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7300000000000002e-07 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271380+0000", 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7519999999999999e-06 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271385+0000", 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7409999999999998e-06 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271390+0000", 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3429999999999998e-06 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35707 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272032+0000", 2024-09-18T00:32:12.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011287201, 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016893648000000001, 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35707 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272032+0000", 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272032+0000", 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272032+0000", 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272034+0000", 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8619999999999999e-06 2024-09-18T00:32:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272040+0000", 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272044+0000", 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5299999999999998e-06 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35739 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272653+0000", 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010666237, 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016326548999999999, 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35739 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272653+0000", 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272653+0000", 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272653+0000", 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9000000000000002e-07 2024-09-18T00:32:12.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272655+0000", 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7880000000000001e-06 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272661+0000", 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5770000000000001e-06 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272665+0000", 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4549999999999997e-06 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35771 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273246+0000", 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010073299000000001, 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015786853, 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35771 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273246+0000", 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273246+0000", 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273246+0000", 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1e-07 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273248+0000", 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.795e-06 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273254+0000", 2024-09-18T00:32:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6609999999999997e-06 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273258+0000", 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4460000000000003e-06 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36189 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279925+0000", 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00339384, 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091586159999999996, 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36189 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279925+0000", 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279925+0000", 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279926+0000", 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279928+0000", 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9230000000000001e-06 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279934+0000", 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7950000000000004e-06 2024-09-18T00:32:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279938+0000", 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3239999999999996e-06 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36221 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280693+0000", 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0026263990000000002, 2024-09-18T00:32:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084433489999999993, 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36221 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280693+0000", 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280693+0000", 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280693+0000", 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3099999999999998e-07 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280695+0000", 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.945e-06 2024-09-18T00:32:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280701+0000", 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.609e-06 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280706+0000", 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7360000000000001e-06 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36253 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282611+0000", 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00070781399999999997, 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065777149999999996, 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36253 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282611+0000", 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282611+0000", 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282612+0000", 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282700+0000", 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8423000000000004e-05 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282716+0000", 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6206999999999999e-05 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282723+0000", 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7059999999999998e-06 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35676 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271396+0000", 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011923289, 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01784825, 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35676 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271396+0000", 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271396+0000", 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271396+0000", 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271398+0000", 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.781e-06 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271404+0000", 2024-09-18T00:32:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1419999999999998e-06 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271409+0000", 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1610000000000002e-06 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35708 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272050+0000", 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011269579, 2024-09-18T00:32:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245130000000001, 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35708 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272050+0000", 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272050+0000", 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272050+0000", 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272052+0000", 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8309999999999999e-06 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272057+0000", 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5280000000000003e-06 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272062+0000", 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3529999999999997e-06 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35740 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272670+0000", 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.01064876, 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016676151, 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35740 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272670+0000", 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272670+0000", 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272671+0000", 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272672+0000", 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.601e-06 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272678+0000", 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0809999999999999e-06 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272683+0000", 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35772 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273263+0000", 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010055817999999999, 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017214353000000002, 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35772 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273263+0000", 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273263+0000", 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273264+0000", 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5699999999999998e-07 2024-09-18T00:32:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273266+0000", 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273272+0000", 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9869999999999996e-06 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273276+0000", 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3610000000000003e-06 2024-09-18T00:32:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36190 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279944+0000", 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0033757259999999999, 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010588459999999999, 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36190 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279944+0000", 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279944+0000", 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279944+0000", 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279946+0000", 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9640000000000002e-06 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279952+0000", 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7300000000000002e-06 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279956+0000", 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36222 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280712+0000", 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.002606911, 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0098710599999999992, 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36222 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280712+0000", 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280712+0000", 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280713+0000", 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280715+0000", 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8899999999999999e-06 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280720+0000", 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280725+0000", 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36254 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282962+0000", 2024-09-18T00:32:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00035685300000000002, 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076731960000000002, 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36254 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282962+0000", 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282962+0000", 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282963+0000", 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7599999999999997e-07 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282966+0000", 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.427e-06 2024-09-18T00:32:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282976+0000", 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6819999999999998e-06 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283005+0000", 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8623999999999999e-05 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35677 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271415+0000", 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011904056, 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019274409999999999, 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35677 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271415+0000", 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271415+0000", 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271416+0000", 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271417+0000", 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7689999999999999e-06 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271423+0000", 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.716e-06 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271427+0000", 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35709 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272067+0000", 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011252061000000001, 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018674089000000001, 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35709 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272067+0000", 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272067+0000", 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272068+0000", 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.65e-07 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272073+0000", 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0980000000000001e-06 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272079+0000", 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9510000000000003e-06 2024-09-18T00:32:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272083+0000", 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35741 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272689+0000", 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010630618999999999, 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018104555000000001, 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35741 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272689+0000", 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272689+0000", 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272689+0000", 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272692+0000", 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.632e-06 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272697+0000", 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7030000000000003e-06 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272702+0000", 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4039999999999997e-06 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35773 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273281+0000", 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010038152, 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017563985000000001, 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35773 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273281+0000", 2024-09-18T00:32:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273281+0000", 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273281+0000", 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4299999999999999e-07 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273283+0000", 2024-09-18T00:32:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6360000000000001e-06 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273289+0000", 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.789e-06 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273293+0000", 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2089999999999999e-06 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36191 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279963+0000", 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0033557980000000001, 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010940202, 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36191 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279963+0000", 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279963+0000", 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279964+0000", 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6800000000000001e-07 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279966+0000", 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279971+0000", 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5119999999999999e-06 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279976+0000", 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4730000000000002e-06 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36223 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280730+0000", 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0025890520000000001, 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010228404, 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36223 2024-09-18T00:32:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280730+0000", 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280730+0000", 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280731+0000", 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.77e-07 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280736+0000", 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3340000000000001e-06 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280742+0000", 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8270000000000003e-06 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280747+0000", 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9139999999999999e-06 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36255 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283048+0000", 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000271508, 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079639470000000007, 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36255 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283048+0000", 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283048+0000", 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283048+0000", 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.23e-07 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283052+0000", 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0529999999999998e-06 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283059+0000", 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:32:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283065+0000", 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6860000000000003e-06 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35678 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.271433+0000", 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011885867, 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019635209000000001, 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35678 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271433+0000", 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271433+0000", 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271434+0000", 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0699999999999998e-07 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271436+0000", 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8530000000000001e-06 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271441+0000", 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.271446+0000", 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9439999999999996e-06 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.291053+0000", 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019606417000000001 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35710 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272089+0000", 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011229803, 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019039829000000001, 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35710 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272089+0000", 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272089+0000", 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272090+0000", 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272092+0000", 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7540000000000001e-06 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272097+0000", 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8189999999999997e-06 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272102+0000", 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35742 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272707+0000", 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010611888999999999, 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018473619, 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35742 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272707+0000", 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272707+0000", 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272708+0000", 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6899999999999998e-07 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272709+0000", 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6270000000000001e-06 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272715+0000", 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6049999999999997e-06 2024-09-18T00:32:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272719+0000", 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4669999999999998e-06 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35774 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273298+0000", 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0100208, 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017935547999999999, 2024-09-18T00:32:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35774 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273298+0000", 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273298+0000", 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273299+0000", 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273301+0000", 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7969999999999999e-06 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273306+0000", 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7490000000000004e-06 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273314+0000", 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7919999999999993e-06 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36192 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279981+0000", 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0033380480000000001, 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011303323000000001, 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36192 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279981+0000", 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279981+0000", 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279982+0000", 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.77e-07 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279983+0000", 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.77e-06 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279989+0000", 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5949999999999998e-06 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279994+0000", 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7180000000000004e-06 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36224 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280753+0000", 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0025666809999999999, 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010585878, 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36224 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280753+0000", 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280753+0000", 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280753+0000", 2024-09-18T00:32:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280755+0000", 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280760+0000", 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6999999999999996e-06 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280768+0000", 2024-09-18T00:32:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3320000000000003e-06 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36256 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283074+0000", 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00024527499999999999, 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0083175799999999998, 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36256 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283074+0000", 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283074+0000", 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283075+0000", 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3600000000000004e-07 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283077+0000", 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3099999999999999e-06 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283083+0000", 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.533e-06 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283091+0000", 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0039999999999999e-06 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35711 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272107+0000", 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011211921999999999, 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019341354000000002, 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35711 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272107+0000", 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272107+0000", 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272108+0000", 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4799999999999999e-07 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272110+0000", 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4119999999999999e-06 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272116+0000", 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1419999999999998e-06 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272125+0000", 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7229999999999993e-06 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35743 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272725+0000", 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010594619, 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018777151999999998, 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35743 2024-09-18T00:32:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272725+0000", 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272725+0000", 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272725+0000", 2024-09-18T00:32:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0699999999999998e-07 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272727+0000", 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.699e-06 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272732+0000", 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272737+0000", 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35775 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273320+0000", 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0099996949999999994, 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018236001000000002, 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35775 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273320+0000", 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273320+0000", 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273320+0000", 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9400000000000001e-07 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273322+0000", 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.807e-06 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273328+0000", 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.852e-06 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273335+0000", 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3130000000000001e-06 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36193 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280000+0000", 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0033194489999999999, 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011610785, 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36193 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280000+0000", 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280000+0000", 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280000+0000", 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.39e-07 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280002+0000", 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9250000000000002e-06 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280008+0000", 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7930000000000003e-06 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280031+0000", 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3462e-05 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36225 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280774+0000", 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0025452740000000001, 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010890044999999999, 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36225 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280774+0000", 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280774+0000", 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280774+0000", 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280776+0000", 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9400000000000001e-06 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280782+0000", 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6729999999999997e-06 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280789+0000", 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1319999999999996e-06 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36257 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283120+0000", 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000199376, 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085974239999999993, 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36257 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283120+0000", 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283120+0000", 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283120+0000", 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2399999999999998e-07 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283123+0000", 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4219999999999999e-06 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283130+0000", 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9689999999999997e-06 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283134+0000", 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6299999999999997e-06 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35712 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272131+0000", 2024-09-18T00:32:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011188579000000001, 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019641208, 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35712 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272131+0000", 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272131+0000", 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272131+0000", 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272133+0000", 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7519999999999999e-06 2024-09-18T00:32:12.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272138+0000", 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6189999999999999e-06 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272143+0000", 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4290000000000003e-06 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35744 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272742+0000", 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010577204999999999, 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019083668000000002, 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35744 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272742+0000", 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272742+0000", 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272742+0000", 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1e-07 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272744+0000", 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272750+0000", 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6729999999999997e-06 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272754+0000", 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6840000000000004e-06 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35776 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273340+0000", 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0099789289999999992, 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018543362000000001, 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35776 2024-09-18T00:32:12.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273340+0000", 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273340+0000", 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273341+0000", 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273342+0000", 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8330000000000001e-06 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273348+0000", 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7960000000000001e-06 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273353+0000", 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3050000000000003e-06 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36194 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280039+0000", 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0032801919999999999, 2024-09-18T00:32:12.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011897345, 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36194 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280039+0000", 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280039+0000", 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280039+0000", 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280042+0000", 2024-09-18T00:32:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2649999999999999e-06 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280048+0000", 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3940000000000001e-06 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280053+0000", 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0690000000000001e-06 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36226 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280795+0000", 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.002524334, 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011193117000000001, 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36226 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280795+0000", 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280795+0000", 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280795+0000", 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.01e-07 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280798+0000", 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3020000000000002e-06 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280803+0000", 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5199999999999997e-06 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280808+0000", 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5909999999999998e-06 2024-09-18T00:32:12.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36258 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283141+0000", 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000177942, 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088863959999999995, 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36258 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283141+0000", 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283141+0000", 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283142+0000", 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4200000000000001e-07 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283144+0000", 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1959999999999998e-06 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283150+0000", 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7180000000000001e-06 2024-09-18T00:32:12.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283155+0000", 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.865e-06 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35713 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272148+0000", 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011171383999999999, 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019911963000000001, 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35713 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272148+0000", 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272148+0000", 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272148+0000", 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9999999999999999e-07 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272150+0000", 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7239999999999999e-06 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272155+0000", 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5949999999999998e-06 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272160+0000", 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4959999999999998e-06 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35745 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272760+0000", 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010559693, 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019351760999999999, 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35745 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272760+0000", 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272760+0000", 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272760+0000", 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.41e-07 2024-09-18T00:32:12.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272765+0000", 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8999999999999997e-06 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272771+0000", 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0599999999999996e-06 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272775+0000", 2024-09-18T00:32:12.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35777 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273359+0000", 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0099602809999999996, 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018804900999999999, 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35777 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273359+0000", 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273359+0000", 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273359+0000", 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273361+0000", 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.809e-06 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273367+0000", 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6169999999999998e-06 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273371+0000", 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.578e-06 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36195 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280059+0000", 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0032600670000000002, 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012156866000000001, 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36195 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280059+0000", 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280059+0000", 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280060+0000", 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280062+0000", 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9750000000000001e-06 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280068+0000", 2024-09-18T00:32:12.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0430000000000004e-06 2024-09-18T00:32:12.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280072+0000", 2024-09-18T00:32:12.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5680000000000001e-06 2024-09-18T00:32:12.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36227 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280814+0000", 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0025050340000000002, 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011457024999999999, 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36227 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280814+0000", 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280814+0000", 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280815+0000", 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2399999999999999e-07 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280816+0000", 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8160000000000001e-06 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280827+0000", 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0699999999999999e-05 2024-09-18T00:32:12.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280832+0000", 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0189999999999997e-06 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36259 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283170+0000", 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00014902399999999999, 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091527280000000006, 2024-09-18T00:32:12.691 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36259 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283170+0000", 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283170+0000", 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283171+0000", 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283176+0000", 2024-09-18T00:32:12.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283183+0000", 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.187e-06 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283190+0000", 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.109e-06 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35714 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272165+0000", 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011153985, 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020212198000000001, 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35714 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.695 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272165+0000", 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272165+0000", 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272166+0000", 2024-09-18T00:32:12.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272169+0000", 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1240000000000001e-06 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272174+0000", 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5269999999999998e-06 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272179+0000", 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.369e-06 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35746 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272781+0000", 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010538392000000001, 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019640205000000001, 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35746 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272781+0000", 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272781+0000", 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272781+0000", 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272783+0000", 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.77e-06 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272789+0000", 2024-09-18T00:32:12.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4069999999999998e-06 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272794+0000", 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.578e-06 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35778 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273377+0000", 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0099423510000000003, 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019095421000000001, 2024-09-18T00:32:12.701 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35778 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273377+0000", 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273377+0000", 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273377+0000", 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273379+0000", 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.674e-06 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273384+0000", 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3190000000000002e-06 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273388+0000", 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.031e-06 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36196 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280078+0000", 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0032412000000000001, 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012448854000000001, 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36196 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280078+0000", 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280078+0000", 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280078+0000", 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.34e-07 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280080+0000", 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0449999999999999e-06 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280086+0000", 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8919999999999997e-06 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280091+0000", 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36228 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280846+0000", 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0024733799999999998, 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011727615, 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36228 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280846+0000", 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280846+0000", 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280846+0000", 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280849+0000", 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280867+0000", 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280886+0000", 2024-09-18T00:32:12.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-05 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36260 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283198+0000", 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000121583, 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094265830000000005, 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36260 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283198+0000", 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283198+0000", 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283198+0000", 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4499999999999997e-07 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283200+0000", 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1519999999999999e-06 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283208+0000", 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283212+0000", 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5730000000000001e-06 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35715 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272192+0000", 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011127611000000001, 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020486634, 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35715 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272192+0000", 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272192+0000", 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272192+0000", 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3300000000000003e-07 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272194+0000", 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2840000000000001e-06 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272200+0000", 2024-09-18T00:32:12.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7919999999999998e-06 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272205+0000", 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5299999999999998e-06 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35747 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272799+0000", 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010519896000000001, 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019932617999999999, 2024-09-18T00:32:12.717 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35747 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272799+0000", 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272799+0000", 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272800+0000", 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2399999999999999e-07 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272802+0000", 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.661e-06 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272808+0000", 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4489999999999998e-06 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272813+0000", 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9320000000000004e-06 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.720 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35779 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273394+0000", 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0099255149999999993, 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019392663000000001, 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35779 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273394+0000", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273394+0000", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273394+0000", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5199999999999998e-07 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273396+0000", 2024-09-18T00:32:12.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.674e-06 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273401+0000", 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5779999999999998e-06 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273406+0000", 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36197 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280096+0000", 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0032227990000000001, 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012741614, 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36197 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280096+0000", 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280096+0000", 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280097+0000", 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9700000000000002e-07 2024-09-18T00:32:12.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280099+0000", 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7489999999999999e-06 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280104+0000", 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8719999999999999e-06 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280109+0000", 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6380000000000003e-06 2024-09-18T00:32:12.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36229 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280894+0000", 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0024255069999999999, 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012002595, 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36229 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280894+0000", 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280894+0000", 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280894+0000", 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2499999999999995e-07 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280897+0000", 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6390000000000001e-06 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280903+0000", 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.601e-06 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280908+0000", 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7659999999999998e-06 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36261 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283219+0000", 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000100376, 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097313039999999996, 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36261 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283219+0000", 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283219+0000", 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283219+0000", 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.51e-07 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283222+0000", 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283227+0000", 2024-09-18T00:32:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9789999999999998e-06 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283232+0000", 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4070000000000003e-06 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35716 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272213+0000", 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011106556, 2024-09-18T00:32:12.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020793691999999999, 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35716 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272213+0000", 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272213+0000", 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272213+0000", 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272215+0000", 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7489999999999999e-06 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272221+0000", 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7270000000000004e-06 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272225+0000", 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2259999999999999e-06 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.736 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35748 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272818+0000", 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010501089999999999, 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020239600999999999, 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35748 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272818+0000", 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272818+0000", 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272819+0000", 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.84e-07 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272820+0000", 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.832e-06 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272826+0000", 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5600000000000001e-06 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272830+0000", 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35780 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273411+0000", 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0099082609999999998, 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019699081, 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35780 2024-09-18T00:32:12.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273411+0000", 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273411+0000", 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273411+0000", 2024-09-18T00:32:12.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.58e-07 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273414+0000", 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5160000000000001e-06 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273420+0000", 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7450000000000001e-06 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273424+0000", 2024-09-18T00:32:12.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36198 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280115+0000", 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0032040390000000001, 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013045147, 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36198 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280115+0000", 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280115+0000", 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280116+0000", 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280118+0000", 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280123+0000", 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.694e-06 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280128+0000", 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36230 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280914+0000", 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0024052460000000002, 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012295738000000001, 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36230 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280914+0000", 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280914+0000", 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280914+0000", 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280916+0000", 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0430000000000002e-06 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280929+0000", 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2883e-05 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280939+0000", 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3179999999999996e-06 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36262 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.749 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283238+0000", 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1025000000000004e-05, 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010024664000000001, 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36262 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283238+0000", 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283238+0000", 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283239+0000", 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283241+0000", 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9649999999999998e-06 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283247+0000", 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1469999999999998e-06 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283251+0000", 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0720000000000001e-06 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35717 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272230+0000", 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011089254999999999, 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021086405999999999, 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35717 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.753 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272230+0000", 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272230+0000", 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272230+0000", 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1199999999999999e-07 2024-09-18T00:32:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272232+0000", 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272238+0000", 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3630000000000002e-06 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272242+0000", 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1160000000000001e-06 2024-09-18T00:32:12.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35749 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272836+0000", 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010483551000000001, 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020532331000000001, 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35749 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272836+0000", 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272836+0000", 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272836+0000", 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272838+0000", 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.668e-06 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272844+0000", 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3330000000000002e-06 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272849+0000", 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6059999999999996e-06 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35781 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273441+0000", 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0098783320000000001, 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019977617, 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35781 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273441+0000", 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273441+0000", 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273441+0000", 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273444+0000", 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3949999999999999e-06 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273450+0000", 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5359999999999998e-06 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273455+0000", 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6099999999999999e-06 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36199 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280144+0000", 2024-09-18T00:32:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0031754230000000001, 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013601123, 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36199 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280144+0000", 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280144+0000", 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280144+0000", 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.63e-07 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280149+0000", 2024-09-18T00:32:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1710000000000001e-06 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280155+0000", 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9750000000000004e-06 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280160+0000", 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6809999999999997e-06 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36231 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282054+0000", 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0012650809999999999, 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011746065, 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36231 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282054+0000", 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282054+0000", 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282055+0000", 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1600000000000001e-07 2024-09-18T00:32:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282059+0000", 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8670000000000004e-06 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282071+0000", 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1905e-05 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282092+0000", 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1404999999999999e-05 2024-09-18T00:32:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36263 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283257+0000", 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 6.2491999999999997e-05, 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010594532, 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36263 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283257+0000", 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283257+0000", 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283257+0000", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5400000000000002e-07 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283268+0000", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1181e-05 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283277+0000", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3420000000000008e-06 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283281+0000", 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6569999999999996e-06 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35718 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272248+0000", 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011071572999999999, 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021662463999999999, 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35718 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272248+0000", 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272248+0000", 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272248+0000", 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272250+0000", 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.846e-06 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272256+0000", 2024-09-18T00:32:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.156e-06 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272261+0000", 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5349999999999998e-06 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35750 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272854+0000", 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010465324999999999, 2024-09-18T00:32:12.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021109790999999999, 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35750 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272854+0000", 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272854+0000", 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272854+0000", 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9000000000000002e-07 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272856+0000", 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8920000000000001e-06 2024-09-18T00:32:12.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272862+0000", 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5300000000000004e-06 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272866+0000", 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5210000000000004e-06 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.778 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35782 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273462+0000", 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0098574209999999999, 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020552668999999999, 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35782 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273462+0000", 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273462+0000", 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273462+0000", 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273464+0000", 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1490000000000001e-06 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273470+0000", 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8769999999999998e-06 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273474+0000", 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36200 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280167+0000", 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003152378, 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013896641, 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36200 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.782 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280167+0000", 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280167+0000", 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280167+0000", 2024-09-18T00:32:12.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.75e-07 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280169+0000", 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.838e-06 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280175+0000", 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.626e-06 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280179+0000", 2024-09-18T00:32:12.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6990000000000002e-06 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36232 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282104+0000", 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0012150780000000001, 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012007721000000001, 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36232 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282104+0000", 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282104+0000", 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282105+0000", 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-07 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282108+0000", 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8480000000000001e-06 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282118+0000", 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9539999999999999e-06 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282123+0000", 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.728e-06 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36264 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283296+0000", 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.3142999999999998e-05, 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010868414999999999, 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36264 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283296+0000", 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283296+0000", 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283296+0000", 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.01e-07 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283303+0000", 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9280000000000004e-06 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283309+0000", 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3809999999999998e-06 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283313+0000", 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3470000000000001e-06 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35719 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272267+0000", 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011052236999999999, 2024-09-18T00:32:12.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021952579, 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35719 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272267+0000", 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272267+0000", 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272267+0000", 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3700000000000001e-07 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272269+0000", 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.793e-06 2024-09-18T00:32:12.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272275+0000", 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7459999999999997e-06 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272280+0000", 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6539999999999998e-06 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35751 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272879+0000", 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010439743, 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021391634999999999, 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35751 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272879+0000", 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272879+0000", 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272880+0000", 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.51e-07 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272882+0000", 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.871e-06 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272887+0000", 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6339999999999998e-06 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272892+0000", 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5689999999999998e-06 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35783 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273481+0000", 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0098385060000000003, 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020838248, 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35783 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273481+0000", 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273481+0000", 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273481+0000", 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:12.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273483+0000", 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.12e-06 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273489+0000", 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6559999999999997e-06 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273494+0000", 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6670000000000004e-06 2024-09-18T00:32:12.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36201 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280185+0000", 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0031342639999999999, 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014183046, 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36201 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280185+0000", 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280185+0000", 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280185+0000", 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7599999999999998e-07 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280187+0000", 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8250000000000001e-06 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280201+0000", 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3614e-05 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280206+0000", 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5799999999999999e-06 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36233 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282131+0000", 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0011880770000000001, 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01228658, 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36233 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282131+0000", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282131+0000", 2024-09-18T00:32:12.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282132+0000", 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282134+0000", 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3939999999999999e-06 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282140+0000", 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4269999999999996e-06 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282147+0000", 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2020000000000001e-06 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36265 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283330+0000", 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.999989, 2024-09-18T00:32:12.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011141171, 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36265 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283330+0000", 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283330+0000", 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283331+0000", 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3700000000000001e-07 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283333+0000", 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2900000000000001e-06 2024-09-18T00:32:12.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283346+0000", 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2874000000000001e-05 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283351+0000", 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0429999999999998e-06 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35720 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272285+0000", 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011034472, 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022242748999999999, 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35720 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272285+0000", 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272285+0000", 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272285+0000", 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.77e-07 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272287+0000", 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7519999999999999e-06 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272293+0000", 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.711e-06 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272297+0000", 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4190000000000004e-06 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35752 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272898+0000", 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010421250999999999, 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021682375, 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35752 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272898+0000", 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272898+0000", 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272898+0000", 2024-09-18T00:32:12.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272900+0000", 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.742e-06 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272906+0000", 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6280000000000002e-06 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272910+0000", 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4599999999999996e-06 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35784 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273499+0000", 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0098198629999999999, 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021134620999999999, 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35784 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273499+0000", 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273499+0000", 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273500+0000", 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.77e-07 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273502+0000", 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7740000000000001e-06 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273507+0000", 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7180000000000001e-06 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273512+0000", 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.318e-06 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36202 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280213+0000", 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0031062949999999998, 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014473918000000001, 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36202 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280213+0000", 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280213+0000", 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280213+0000", 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280215+0000", 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0310000000000001e-06 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280222+0000", 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3409999999999999e-06 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280226+0000", 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5299999999999998e-06 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36234 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282187+0000", 2024-09-18T00:32:12.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001132267, 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012553134000000001, 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36234 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282187+0000", 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282187+0000", 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282188+0000", 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6000000000000004e-07 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282190+0000", 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.903e-06 2024-09-18T00:32:12.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282199+0000", 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4679999999999992e-06 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282205+0000", 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6500000000000001e-06 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36266 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283367+0000", 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999518, 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011426206, 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36266 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283367+0000", 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283367+0000", 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283368+0000", 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283376+0000", 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0700000000000007e-06 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283389+0000", 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3634e-05 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283394+0000", 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35721 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272302+0000", 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011016837, 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022523851000000001, 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35721 2024-09-18T00:32:12.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272302+0000", 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272302+0000", 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272303+0000", 2024-09-18T00:32:12.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272308+0000", 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8779999999999997e-06 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272314+0000", 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9610000000000002e-06 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272318+0000", 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35753 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272916+0000", 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010403595, 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021943025000000001, 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35753 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272916+0000", 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272916+0000", 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272916+0000", 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4799999999999999e-07 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272918+0000", 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8059999999999999e-06 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272923+0000", 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6799999999999998e-06 2024-09-18T00:32:12.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272928+0000", 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4560000000000002e-06 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35785 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273517+0000", 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0098017539999999993, 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021389956000000002, 2024-09-18T00:32:12.836 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35785 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273517+0000", 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273517+0000", 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273518+0000", 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.39e-07 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273520+0000", 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9520000000000001e-06 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273526+0000", 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.626e-06 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273530+0000", 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2910000000000001e-06 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36203 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280232+0000", 2024-09-18T00:32:12.839 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0030869819999999998, 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01470249, 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36203 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280232+0000", 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280232+0000", 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280233+0000", 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8099999999999998e-07 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280235+0000", 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.951e-06 2024-09-18T00:32:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280240+0000", 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280245+0000", 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9429999999999999e-06 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36235 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282228+0000", 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0010915040000000001, 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012754444, 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36235 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282228+0000", 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282228+0000", 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282228+0000", 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8400000000000004e-07 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282236+0000", 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1999999999999997e-06 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282243+0000", 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2130000000000002e-06 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282248+0000", 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4079999999999997e-06 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36267 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283415+0000", 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999042, 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011621156000000001, 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36267 2024-09-18T00:32:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283415+0000", 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283415+0000", 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283416+0000", 2024-09-18T00:32:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.65e-07 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283418+0000", 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9240000000000001e-06 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283436+0000", 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8383999999999999e-05 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283441+0000", 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1909999999999999e-06 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35722 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272325+0000", 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010994482, 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022748513000000001, 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35722 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272325+0000", 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272325+0000", 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272325+0000", 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272327+0000", 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.79e-06 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272332+0000", 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272337+0000", 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5159999999999996e-06 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35754 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272934+0000", 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010385238, 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022180485999999999, 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35754 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272934+0000", 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272934+0000", 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272934+0000", 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272936+0000", 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6300000000000001e-06 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272942+0000", 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5829999999999997e-06 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272946+0000", 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4120000000000003e-06 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35786 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273536+0000", 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0097833120000000006, 2024-09-18T00:32:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021629955999999999, 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35786 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273536+0000", 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273536+0000", 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273536+0000", 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9000000000000002e-07 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273538+0000", 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9470000000000002e-06 2024-09-18T00:32:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273544+0000", 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7030000000000003e-06 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273549+0000", 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5569999999999997e-06 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36204 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280252+0000", 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0030667659999999998, 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014941481, 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36204 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280252+0000", 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280252+0000", 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280253+0000", 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280255+0000", 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8729999999999999e-06 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280261+0000", 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7370000000000003e-06 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280265+0000", 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6190000000000002e-06 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36236 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282256+0000", 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0010636510000000001, 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012984343000000001, 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36236 2024-09-18T00:32:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282256+0000", 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282256+0000", 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282256+0000", 2024-09-18T00:32:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282258+0000", 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.351e-06 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282265+0000", 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282270+0000", 2024-09-18T00:32:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36268 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283448+0000", 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998708, 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011843759000000001, 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36268 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283448+0000", 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283448+0000", 2024-09-18T00:32:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283449+0000", 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9999999999999998e-07 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283451+0000", 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2809999999999998e-06 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283465+0000", 2024-09-18T00:32:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3378e-05 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283473+0000", 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3059999999999998e-06 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35723 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272342+0000", 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010976786000000001, 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022990182000000001, 2024-09-18T00:32:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35723 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272342+0000", 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272342+0000", 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272343+0000", 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0499999999999999e-07 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272345+0000", 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.804e-06 2024-09-18T00:32:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272350+0000", 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.203e-06 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272354+0000", 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3100000000000002e-06 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35755 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272951+0000", 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010368005, 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022424781000000001, 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35755 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272951+0000", 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272951+0000", 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272952+0000", 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7800000000000002e-07 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272953+0000", 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7099999999999999e-06 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272959+0000", 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6420000000000004e-06 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272963+0000", 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3730000000000003e-06 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35787 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273554+0000", 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0097652959999999997, 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021849457999999999, 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35787 2024-09-18T00:32:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273554+0000", 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273554+0000", 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273554+0000", 2024-09-18T00:32:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273557+0000", 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5969999999999999e-06 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273562+0000", 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273567+0000", 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.279e-06 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36205 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280271+0000", 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0030482830000000002, 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015172793, 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36205 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280271+0000", 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280271+0000", 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280271+0000", 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6699999999999999e-07 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280273+0000", 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8059999999999999e-06 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280279+0000", 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6049999999999997e-06 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280283+0000", 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3440000000000003e-06 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36237 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282276+0000", 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001043511, 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013220555, 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36237 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282276+0000", 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282276+0000", 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282276+0000", 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.96e-07 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282278+0000", 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9829999999999999e-06 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282284+0000", 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7950000000000004e-06 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282289+0000", 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6290000000000001e-06 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36269 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283481+0000", 2024-09-18T00:32:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998384, 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012066554, 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36269 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283481+0000", 2024-09-18T00:32:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283481+0000", 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283481+0000", 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1600000000000001e-07 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283488+0000", 2024-09-18T00:32:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2289999999999997e-06 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283495+0000", 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7789999999999998e-06 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283505+0000", 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8109999999999997e-06 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35724 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272361+0000", 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010958125000000001, 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.023241751000000001, 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35724 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272361+0000", 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272361+0000", 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272362+0000", 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.01e-07 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272363+0000", 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8619999999999999e-06 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272369+0000", 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5049999999999998e-06 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272373+0000", 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4750000000000004e-06 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35756 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272969+0000", 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010350533, 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022686630999999999, 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35756 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272969+0000", 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272969+0000", 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272969+0000", 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1800000000000002e-07 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272971+0000", 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.64e-06 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272976+0000", 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5779999999999998e-06 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272981+0000", 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3780000000000003e-06 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35788 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273572+0000", 2024-09-18T00:32:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0097471390000000002, 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022135269999999999, 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35788 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273572+0000", 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273572+0000", 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273572+0000", 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8299999999999998e-07 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273574+0000", 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7770000000000001e-06 2024-09-18T00:32:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273580+0000", 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.31e-06 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273584+0000", 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2150000000000003e-06 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36206 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280289+0000", 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0030305039999999998, 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015469113, 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36206 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280289+0000", 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280289+0000", 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280289+0000", 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7800000000000002e-07 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280291+0000", 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.841e-06 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280296+0000", 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3449999999999996e-06 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280301+0000", 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3939999999999998e-06 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36238 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282294+0000", 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001025085, 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013502579000000001, 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36238 2024-09-18T00:32:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282294+0000", 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282294+0000", 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282295+0000", 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9299999999999999e-07 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282296+0000", 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.804e-06 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282302+0000", 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282307+0000", 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.279e-06 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36270 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283512+0000", 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998069, 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012332872, 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36270 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283512+0000", 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283512+0000", 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283513+0000", 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7e-07 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283515+0000", 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.182e-06 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283528+0000", 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3101999999999999e-05 2024-09-18T00:32:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283533+0000", 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35725 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272379+0000", 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010940475, 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.023520991000000002, 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35725 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272379+0000", 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272379+0000", 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272379+0000", 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272382+0000", 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1470000000000001e-06 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272388+0000", 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6529999999999999e-06 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272393+0000", 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.605e-06 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35757 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272986+0000", 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010333187000000001, 2024-09-18T00:32:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022941098, 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35757 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272986+0000", 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272986+0000", 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272986+0000", 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.65e-07 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272991+0000", 2024-09-18T00:32:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0370000000000002e-06 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272997+0000", 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9560000000000002e-06 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273002+0000", 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6650000000000002e-06 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35789 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273601+0000", 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0097183430000000008, 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022373994000000001, 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35789 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273601+0000", 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273601+0000", 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273601+0000", 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6899999999999998e-07 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273603+0000", 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273807+0000", 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020421799999999999 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273814+0000", 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3400000000000003e-06 2024-09-18T00:32:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36207 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280319+0000", 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0029997550000000002, 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015708547, 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36207 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280319+0000", 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280319+0000", 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280320+0000", 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6499999999999999e-07 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280322+0000", 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1459999999999999e-06 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280328+0000", 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8619999999999999e-06 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280333+0000", 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9110000000000001e-06 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36239 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282312+0000", 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0010068919999999999, 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013768944, 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36239 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282312+0000", 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282312+0000", 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282313+0000", 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282315+0000", 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8929999999999999e-06 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282320+0000", 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7019999999999998e-06 2024-09-18T00:32:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282325+0000", 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5140000000000003e-06 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36271 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283545+0000", 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.999774, 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012593165, 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36271 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283545+0000", 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283545+0000", 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283546+0000", 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283551+0000", 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0019999999999997e-06 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283556+0000", 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283560+0000", 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3189999999999996e-06 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35726 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272398+0000", 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010921376, 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.023796154999999999, 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35726 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272398+0000", 2024-09-18T00:32:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272398+0000", 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272398+0000", 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272400+0000", 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.809e-06 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272406+0000", 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272410+0000", 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3930000000000001e-06 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35758 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273008+0000", 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010311654, 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.023240203000000001, 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35758 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273008+0000", 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273008+0000", 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273008+0000", 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273010+0000", 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.413e-06 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273016+0000", 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8379999999999998e-06 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273021+0000", 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5959999999999997e-06 2024-09-18T00:32:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36176 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.278981+0000", 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0043380220000000004, 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017320887, 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36176 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.278981+0000", 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.278981+0000", 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.278982+0000", 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.06e-06 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.278988+0000", 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.519e-06 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.278998+0000", 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8709999999999992e-06 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279005+0000", 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1729999999999998e-06 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36208 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280339+0000", 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.002980066, 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016018609999999999, 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36208 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280339+0000", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280339+0000", 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280340+0000", 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3200000000000001e-07 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280341+0000", 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280347+0000", 2024-09-18T00:32:12.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7930000000000003e-06 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280352+0000", 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6970000000000001e-06 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36240 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282330+0000", 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00098896199999999991, 2024-09-18T00:32:12.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014081956, 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36240 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282330+0000", 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282330+0000", 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282331+0000", 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7000000000000005e-07 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282333+0000", 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0209999999999998e-06 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282339+0000", 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282343+0000", 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36272 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283574+0000", 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9997449, 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012891846, 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36272 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283574+0000", 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283574+0000", 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283575+0000", 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0200000000000003e-07 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283577+0000", 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9659999999999999e-06 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283583+0000", 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0689999999999998e-06 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283587+0000", 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35727 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272415+0000", 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010903955, 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024106796, 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35727 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.948 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272415+0000", 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272415+0000", 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272416+0000", 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.77e-07 2024-09-18T00:32:12.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272417+0000", 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6339999999999999e-06 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272423+0000", 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5779999999999998e-06 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272428+0000", 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5110000000000003e-06 2024-09-18T00:32:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35759 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273027+0000", 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010292714, 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02354914, 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35759 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273027+0000", 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273027+0000", 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273027+0000", 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273029+0000", 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8419999999999999e-06 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273034+0000", 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6169999999999998e-06 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273039+0000", 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36177 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279018+0000", 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0043015379999999997, 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017612158999999999, 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36177 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279018+0000", 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279018+0000", 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279018+0000", 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0500000000000004e-07 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279021+0000", 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9799999999999998e-06 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279028+0000", 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-18T00:32:12.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279033+0000", 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0289999999999996e-06 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36209 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280357+0000", 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0029620039999999999, 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016325333000000001, 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36209 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280357+0000", 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280357+0000", 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280358+0000", 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5600000000000001e-07 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280359+0000", 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9e-06 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280365+0000", 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7749999999999998e-06 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280370+0000", 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5770000000000004e-06 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36241 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282349+0000", 2024-09-18T00:32:12.960 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00097020199999999998, 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014386858000000001, 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36241 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282349+0000", 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282349+0000", 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282349+0000", 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8299999999999998e-07 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282353+0000", 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1200000000000002e-06 2024-09-18T00:32:12.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282358+0000", 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9159999999999998e-06 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282363+0000", 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5020000000000003e-06 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.963 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36273 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283601+0000", 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9997182, 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013175040000000001, 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36273 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283601+0000", 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283601+0000", 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283602+0000", 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4200000000000001e-07 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283604+0000", 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2680000000000001e-06 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283610+0000", 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2580000000000001e-06 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283628+0000", 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8161000000000001e-05 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35728 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.272434+0000", 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010885198, 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024392121999999999, 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35728 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272434+0000", 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272434+0000", 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272434+0000", 2024-09-18T00:32:12.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6899999999999998e-07 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272436+0000", 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7039999999999999e-06 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272442+0000", 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7649999999999999e-06 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.272446+0000", 2024-09-18T00:32:12.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5920000000000002e-06 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:35760 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.273044+0000", 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.010275098, 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.023816436, 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 35760 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273044+0000", 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273044+0000", 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273045+0000", 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6800000000000001e-07 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273046+0000", 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7039999999999999e-06 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273052+0000", 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.57e-06 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.273056+0000", 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3290000000000004e-06 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36178 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.279039+0000", 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.004280252, 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017855731, 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36178 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279039+0000", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279039+0000", 2024-09-18T00:32:12.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279039+0000", 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279041+0000", 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9910000000000001e-06 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279047+0000", 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9540000000000001e-06 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.279052+0000", 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0100000000000003e-06 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36210 3.7 3.2d179f67 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.280375+0000", 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0029440239999999999, 2024-09-18T00:32:12.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016549331, 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36210 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280375+0000", 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280375+0000", 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280376+0000", 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5600000000000001e-07 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280377+0000", 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7010000000000001e-06 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280402+0000", 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5222999999999999e-05 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.280411+0000", 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5660000000000007e-06 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36242 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.282368+0000", 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00095086699999999999, 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014598719, 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36242 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282368+0000", 2024-09-18T00:32:12.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282368+0000", 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282369+0000", 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9100000000000004e-07 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282371+0000", 2024-09-18T00:32:12.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.79e-06 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282376+0000", 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.282381+0000", 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2939999999999999e-06 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:36274 3.7 3.ab70b967 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.283636+0000", 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9996839, 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013387288000000001, 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36274 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283636+0000", 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283636+0000", 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283636+0000", 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3700000000000001e-07 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283646+0000", 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8980000000000008e-06 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283651+0000", 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1839999999999998e-06 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.283656+0000", 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4440000000000001e-06 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:12.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:12.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:12.986 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 206 2024-09-18T00:32:12.986 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:12.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:12.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1466 write 0x74e874a thru 0x74e901e (0x8d5 bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1470 write 0x8dd10a2 thru 0x8dd807f (0x6fde bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1471 writesame 0x4c4276a thru 0x4c4b624 data_size 0x1(0x8ebb bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1474 punch from 0x5e3f5ec to 0x5e4ced8, (0xd8ec bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1475 read 0x101bed thru 0x10ef89 (0xd39d bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1477 punch from 0x51c4bd0 to 0x51cd421, (0x8851 bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1479 read 0x129711a thru 0x12a272c (0xb613 bytes) 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:1483 punch from 0x228c6e5 to 0x2295473, (0x8d8e bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1485 trunc from 0x9f405c5 to 0x5840f4f 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1486 punch from 0x200f661 to 0x201b3a7, (0xbd46 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1487 read 0x1e2c68e thru 0x1e2c876 (0x1e9 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1488 punch from 0x12cf81 to 0x1347ba, (0x7839 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1491 punch from 0xf2aad6 to 0xf2bc3e, (0x1168 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1492 read 0x38d32c thru 0x399a6d (0xc742 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1494 trunc from 0x5840f4f to 0x833a303 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1496 punch from 0x3a37c5c to 0x3a40524, (0x88c8 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1498 read 0x1ce13b thru 0x1d18b0 (0x3776 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1499 punch from 0xe26b5f to 0xe31c2e, (0xb0cf bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1501 read 0x7d090e7 thru 0x7d105d9 (0x74f3 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1503 punch from 0x6a3528 to 0x6a4357, (0xe2f bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1504 writesame 0xafd7951 thru 0xafde614 data_size 0x2(0x6cc4 bytes) 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.993 INFO:teuthology.orchestra.run.smithi081.stdout:1511 writesame 0x3278e37 thru 0x3283513 data_size 0x3(0xa6dd bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1512 write 0x4b2714e thru 0x4b28f3f (0x1df2 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1514 write 0x2f2a84b thru 0x2f2e5f1 (0x3da7 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1515 read 0x438b3dd thru 0x439a4c8 (0xf0ec bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1517 punch from 0x8354156 to 0x8354846, (0x6f0 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1520 read 0xe79fc7 thru 0xe899ed (0xfa27 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1521 write 0x594e9ba thru 0x5953293 (0x48da bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1522 write 0xf364da thru 0xf3d07f (0x6ba6 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1524 read 0x949d2a2 thru 0x94aaa77 (0xd7d6 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1527 writesame 0x2b84163 thru 0x2b8a137 data_size 0x1(0x5fd5 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1528 punch from 0x961c44b to 0x9622ea4, (0x6a59 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1529 write 0x52fe11b thru 0x530952d (0xb413 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1530 punch from 0x6a6730c to 0x6a71c6f, (0xa963 bytes) 2024-09-18T00:32:12.994 INFO:teuthology.orchestra.run.smithi081.stdout:1531 read 0xb08f24 thru 0xb0af34 (0x2011 bytes) 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:1533 write 0x1403873 thru 0x140d980 (0xa10e bytes) 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:1534 read 0xafca90f thru 0xafcb2f6 (0x9e8 bytes) 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:1535 read 0x902d4a7 thru 0x9037bd3 (0xa72d bytes) 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:1536 read 0x4592b21 thru 0x4596f15 (0x43f5 bytes) 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:1538 write 0x2d16673 thru 0x2d1f902 (0x9290 bytes) 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stdout:1539 clone 16 order 23 su 65536 sc 4 2024-09-18T00:32:12.995 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:32:12.995 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:12.985+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:13.077 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone15 from 0xafde615 (overlap 0x5840f4f) to 0x469a5d8 2024-09-18T00:32:13.088 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:13.086+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:13.159 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:13.160 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:13.160 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:13.160 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:13.160 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:13.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:13.175 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:13.189 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:13.188+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:13.192 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:13.192 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:13.210 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:13.242 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:13.242 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:13.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:13.265 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:13.270 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-18T00:32:13.283 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:13.283 INFO:teuthology.orchestra.run.smithi081.stdout:1540 writesame 0xc6d4211 thru 0xc6dcf5b data_size 0x3(0x8d4b bytes) 2024-09-18T00:32:13.283 INFO:teuthology.orchestra.run.smithi081.stdout:1542 read 0x48d6c30 thru 0x48e404a (0xd41b bytes) 2024-09-18T00:32:13.290 INFO:teuthology.orchestra.run.smithi081.stdout:1543 trunc from 0xc6dcf5c to 0x71718a0 2024-09-18T00:32:13.290 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:13.289+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:13.302 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:13.304 INFO:teuthology.orchestra.run.smithi081.stdout:1544 read 0x3f1e180 thru 0x3f23495 (0x5316 bytes) 2024-09-18T00:32:13.304 INFO:teuthology.orchestra.run.smithi081.stdout:1545 writesame 0xe252b6 thru 0xe34c00 data_size 0x15(0xf94b bytes) 2024-09-18T00:32:13.304 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:13.304 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:13.320 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:13.356 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:13.357 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:13.392 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:13.391+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:13.409 INFO:teuthology.orchestra.run.smithi081.stdout:1546 read 0x19c247f thru 0x19c2c63 (0x7e5 bytes) 2024-09-18T00:32:13.409 INFO:teuthology.orchestra.run.smithi081.stdout:1548 punch from 0x3db13a6 to 0x3dc0bb5, (0xf80f bytes) 2024-09-18T00:32:13.421 INFO:teuthology.orchestra.run.smithi081.stdout:1551 write 0xc27b2ca thru 0xc281c76 (0x69ad bytes) 2024-09-18T00:32:13.451 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:13.452 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:13.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:13.502 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:13.500+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:13.595 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:13.594+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:13.603 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:13.603 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:13.611 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:13.627 INFO:teuthology.orchestra.run.smithi081.stdout:1553 write 0x332a432 thru 0x3338e01 (0xe9d0 bytes) 2024-09-18T00:32:13.689 INFO:teuthology.orchestra.run.smithi081.stdout:1554 write 0x3737c03 thru 0x3743f6f (0xc36d bytes) 2024-09-18T00:32:13.695 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:13.694+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:13.731 INFO:teuthology.orchestra.run.smithi081.stdout:1555 read 0xc0d1aa8 thru 0xc0d4d8f (0x32e8 bytes) 2024-09-18T00:32:13.731 INFO:teuthology.orchestra.run.smithi081.stdout:1556 read 0x7739c61 thru 0x7746f20 (0xd2c0 bytes) 2024-09-18T00:32:13.732 INFO:teuthology.orchestra.run.smithi081.stdout:1557 read 0x52868f1 thru 0x528fb81 (0x9291 bytes) 2024-09-18T00:32:13.732 INFO:teuthology.orchestra.run.smithi081.stdout:1558 write 0x750f754 thru 0x751eba7 (0xf454 bytes) 2024-09-18T00:32:13.734 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:13.734 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:13.734 INFO:teuthology.orchestra.run.smithi081.stdout:1559 read 0x6ddc9eb thru 0x6de7689 (0xac9f bytes) 2024-09-18T00:32:13.734 INFO:teuthology.orchestra.run.smithi081.stdout:1560 read 0x8ab9933 thru 0x8ac02d2 (0x69a0 bytes) 2024-09-18T00:32:13.734 INFO:teuthology.orchestra.run.smithi081.stdout:1561 write 0x25593c6 thru 0x2562281 (0x8ebc bytes) 2024-09-18T00:32:13.744 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:13.775 INFO:teuthology.orchestra.run.smithi081.stdout:1562 writesame 0xc2472bf thru 0xc25385b data_size 0x3f(0xc59d bytes) 2024-09-18T00:32:13.780 INFO:teuthology.orchestra.run.smithi081.stdout:1564 write 0x90e975b thru 0x90ea9eb (0x1291 bytes) 2024-09-18T00:32:13.783 INFO:teuthology.orchestra.run.smithi081.stdout:1565 read 0x3fd430c thru 0x3fda2d4 (0x5fc9 bytes) 2024-09-18T00:32:13.783 INFO:teuthology.orchestra.run.smithi081.stdout:1567 punch from 0x874cd1e to 0x874e533, (0x1815 bytes) 2024-09-18T00:32:13.784 INFO:teuthology.orchestra.run.smithi081.stdout:1568 read 0x2e23084 thru 0x2e27ff0 (0x4f6d bytes) 2024-09-18T00:32:13.784 INFO:teuthology.orchestra.run.smithi081.stdout:1569 read 0x413d4d9 thru 0x41471d6 (0x9cfe bytes) 2024-09-18T00:32:13.784 INFO:teuthology.orchestra.run.smithi081.stdout:1570 punch from 0x75102aa to 0x7513af1, (0x3847 bytes) 2024-09-18T00:32:13.784 INFO:teuthology.orchestra.run.smithi081.stdout:1571 writesame 0xa076388 thru 0xa079f3c data_size 0x5(0x3bb5 bytes) 2024-09-18T00:32:13.789 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:13.789 INFO:teuthology.orchestra.run.smithi081.stdout:1573 read 0x4589821 thru 0x458eda3 (0x5583 bytes) 2024-09-18T00:32:13.790 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:13.790 INFO:teuthology.orchestra.run.smithi081.stdout:1575 punch from 0xaef88e1 to 0xaefdc3c, (0x535b bytes) 2024-09-18T00:32:13.790 INFO:teuthology.orchestra.run.smithi081.stdout:1576 punch from 0x2c1fdcb to 0x2c26939, (0x6b6e bytes) 2024-09-18T00:32:13.790 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:13.791 INFO:teuthology.orchestra.run.smithi081.stdout:1579 read 0xae2b6f7 thru 0xae3a952 (0xf25c bytes) 2024-09-18T00:32:13.791 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:13.791 INFO:teuthology.orchestra.run.smithi081.stdout:1581 write 0x5d31bf1 thru 0x5d3db77 (0xbf87 bytes) 2024-09-18T00:32:13.796 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:13.794+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:13.831 INFO:teuthology.orchestra.run.smithi081.stdout:1582 write 0xe176ba2 thru 0xe17bbab (0x500a bytes) 2024-09-18T00:32:13.835 INFO:teuthology.orchestra.run.smithi081.stdout:1583 write 0x396123d thru 0x3961c32 (0x9f6 bytes) 2024-09-18T00:32:13.836 INFO:teuthology.orchestra.run.smithi081.stdout:1584 clone 17 order 23 su 524288 sc 5 2024-09-18T00:32:13.859 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:13.859 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:13.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:13.909 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:13.907+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:13.998 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:13.996+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:14.015 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.015 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.024 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:14.098 INFO:teuthology.orchestra.run.smithi081.stdout:flattening image image_client.0-clone16 2024-09-18T00:32:14.098 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:14.097+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:14.158 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.159 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:14.199 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:14.198+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:14.285 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.285 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.293 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:14.300 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:14.299+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:14.398 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.398 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.401 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:14.399+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:14.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:14.464 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-18T00:32:14.501 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:14.500+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:14.592 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.593 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.601 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:14.602 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:14.601+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:14.704 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:14.702+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:14.711 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.711 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:14.743 INFO:teuthology.orchestra.run.smithi081.stdout:1587 punch from 0x8ad7b39 to 0x8ae1030, (0x94f7 bytes) 2024-09-18T00:32:14.747 INFO:teuthology.orchestra.run.smithi081.stdout:1591 read 0x41d46b1 thru 0x41dea7f (0xa3cf bytes) 2024-09-18T00:32:14.748 INFO:teuthology.orchestra.run.smithi081.stdout:1592 read 0x7f53577 thru 0x7f5ea41 (0xb4cb bytes) 2024-09-18T00:32:14.748 INFO:teuthology.orchestra.run.smithi081.stdout:1594 read 0xb6c790f thru 0xb6d6759 (0xee4b bytes) 2024-09-18T00:32:14.748 INFO:teuthology.orchestra.run.smithi081.stdout:1596 writesame 0xd0e374f thru 0xd0e9c03 data_size 0x1d(0x64b5 bytes) 2024-09-18T00:32:14.754 INFO:teuthology.orchestra.run.smithi081.stdout:1597 read 0x6fbd56f thru 0x6fbef80 (0x1a12 bytes) 2024-09-18T00:32:14.755 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:14.755 INFO:teuthology.orchestra.run.smithi081.stdout:1599 read 0xd80c9d4 thru 0xd8142cd (0x78fa bytes) 2024-09-18T00:32:14.755 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:14.755 INFO:teuthology.orchestra.run.smithi081.stdout:1604 write 0xe01b97d thru 0xe02092e (0x4fb2 bytes) 2024-09-18T00:32:14.760 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:14.760 INFO:teuthology.orchestra.run.smithi081.stdout:1606 read 0x34d1f17 thru 0x34d6edb (0x4fc5 bytes) 2024-09-18T00:32:14.760 INFO:teuthology.orchestra.run.smithi081.stdout:1607 punch from 0xb8ae221 to 0xb8b9ded, (0xbbcc bytes) 2024-09-18T00:32:14.760 INFO:teuthology.orchestra.run.smithi081.stdout:1608 read 0xf16398 thru 0xf1c8dc (0x6545 bytes) 2024-09-18T00:32:14.761 INFO:teuthology.orchestra.run.smithi081.stdout:1612 write 0xa3f4473 thru 0xa402f91 (0xeb1f bytes) 2024-09-18T00:32:14.769 INFO:teuthology.orchestra.run.smithi081.stdout:1613 writesame 0x1fff47f thru 0x20045ba data_size 0x6(0x513c bytes) 2024-09-18T00:32:14.805 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:14.803+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:1614 write 0x85531fd thru 0x855fbf8 (0xc9fc bytes) 2024-09-18T00:32:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:1615 writesame 0x97ee3f thru 0x984858 data_size 0x13(0x5a1a bytes) 2024-09-18T00:32:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:1619 write 0xdd9e0f6 thru 0xdda4af0 (0x69fb bytes) 2024-09-18T00:32:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:1622 trunc from 0xe17bbac to 0x737c2e4 2024-09-18T00:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:1624 writesame 0x8443193 thru 0x844edbe data_size 0x2(0xbc2c bytes) 2024-09-18T00:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:1625 read 0x42f75bd thru 0x42f8bea (0x162e bytes) 2024-09-18T00:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:1627 read 0x7b57ac4 thru 0x7b60183 (0x86c0 bytes) 2024-09-18T00:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:1628 punch from 0x78620e2 to 0x78686c7, (0x65e5 bytes) 2024-09-18T00:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:1630 punch from 0x75b7c93 to 0x75b89b9, (0xd26 bytes) 2024-09-18T00:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:1631 writesame 0x117c2bd thru 0x11890fe data_size 0x11(0xce42 bytes) 2024-09-18T00:32:14.882 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:14.882 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:14.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:14.905 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:14.904+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:1634 trunc from 0x844edbf to 0x4de1fdb 2024-09-18T00:32:14.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:32:14.999 INFO:teuthology.orchestra.run.smithi081.stdout:1635 write 0x719c759 thru 0x71a8b31 (0xc3d9 bytes) 2024-09-18T00:32:15.002 INFO:teuthology.orchestra.run.smithi081.stdout:1639 write 0x5accda5 thru 0x5ad2a11 (0x5c6d bytes) 2024-09-18T00:32:15.005 INFO:teuthology.orchestra.run.smithi081.stdout:1642 read 0x5eb88e6 thru 0x5ec4ecb (0xc5e6 bytes) 2024-09-18T00:32:15.005 INFO:teuthology.orchestra.run.smithi081.stdout:1643 read 0x6e265c5 thru 0x6e2bba5 (0x55e1 bytes) 2024-09-18T00:32:15.006 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:15.005+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:15.011 INFO:teuthology.orchestra.run.smithi081.stdout:1644 trunc from 0x71a8b32 to 0xc90a485 2024-09-18T00:32:15.016 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:15.016 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:15.017 INFO:teuthology.orchestra.run.smithi081.stdout:1645 punch from 0x57878a4 to 0x5788e85, (0x15e1 bytes) 2024-09-18T00:32:15.017 INFO:teuthology.orchestra.run.smithi081.stdout:1646 punch from 0x2d4ac57 to 0x2d545b2, (0x995b bytes) 2024-09-18T00:32:15.018 INFO:teuthology.orchestra.run.smithi081.stdout:1647 write 0x28ccc5c thru 0x28ce0af (0x1454 bytes) 2024-09-18T00:32:15.018 INFO:teuthology.orchestra.run.smithi081.stdout:1650 read 0x4c567d2 thru 0x4c5f6ff (0x8f2e bytes) 2024-09-18T00:32:15.019 INFO:teuthology.orchestra.run.smithi081.stdout:1651 punch from 0x5e29de6 to 0x5e2c3ef, (0x2609 bytes) 2024-09-18T00:32:15.019 INFO:teuthology.orchestra.run.smithi081.stdout:1653 write 0x1f2fee3 thru 0x1f359f3 (0x5b11 bytes) 2024-09-18T00:32:15.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout:1654 read 0x2565468 thru 0x256c28c (0x6e25 bytes) 2024-09-18T00:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout:1655 write 0x3c23343 thru 0x3c2bfda (0x8c98 bytes) 2024-09-18T00:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout:1656 read 0x3aad595 thru 0x3aaf523 (0x1f8f bytes) 2024-09-18T00:32:15.047 INFO:teuthology.orchestra.run.smithi081.stdout:1657 trunc from 0xc90a485 to 0x3bf100a 2024-09-18T00:32:15.059 INFO:teuthology.orchestra.run.smithi081.stdout:1658 read 0x285c58b thru 0x285d731 (0x11a7 bytes) 2024-09-18T00:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout:1661 write 0xc1a432f thru 0xc1a984a (0x551c bytes) 2024-09-18T00:32:15.081 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.093 INFO:teuthology.orchestra.run.smithi081.stdout:1663 trunc from 0xc1a984b to 0x2524e43 2024-09-18T00:32:15.107 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:15.105+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:15.137 INFO:teuthology.orchestra.run.smithi081.stdout:1665 read 0x1803a7f thru 0x180b6f5 (0x7c77 bytes) 2024-09-18T00:32:15.138 INFO:teuthology.orchestra.run.smithi081.stdout:1666 punch from 0x1a231a4 to 0x1a323f2, (0xf24e bytes) 2024-09-18T00:32:15.139 INFO:teuthology.orchestra.run.smithi081.stdout:1668 punch from 0x12e37ab to 0x12e5939, (0x218e bytes) 2024-09-18T00:32:15.139 INFO:teuthology.orchestra.run.smithi081.stdout:1669 read 0x1bc51bc thru 0x1bd06af (0xb4f4 bytes) 2024-09-18T00:32:15.152 INFO:teuthology.orchestra.run.smithi081.stdout:1670 write 0x9225b1d thru 0x922fce7 (0xa1cb bytes) 2024-09-18T00:32:15.155 INFO:teuthology.orchestra.run.smithi081.stdout:1673 writesame 0x2be80cf thru 0x2bec6f3 data_size 0x1(0x4625 bytes) 2024-09-18T00:32:15.166 INFO:teuthology.orchestra.run.smithi081.stdout:1674 write 0x2732eec thru 0x27380b9 (0x51ce bytes) 2024-09-18T00:32:15.168 INFO:teuthology.orchestra.run.smithi081.stdout:1675 write 0x89fd362 thru 0x89fef2c (0x1bcb bytes) 2024-09-18T00:32:15.169 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:15.169 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:15.176 INFO:teuthology.orchestra.run.smithi081.stdout:1676 trunc from 0x922fce8 to 0x4b3993b 2024-09-18T00:32:15.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:15.188 INFO:teuthology.orchestra.run.smithi081.stdout:1677 read 0xba49e6 thru 0xba5a8c (0x10a7 bytes) 2024-09-18T00:32:15.189 INFO:teuthology.orchestra.run.smithi081.stdout:1678 read 0x549e89 thru 0x54d979 (0x3af1 bytes) 2024-09-18T00:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout:1679 writesame 0x9f17128 thru 0x9f1ee51 data_size 0x2(0x7d2a bytes) 2024-09-18T00:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout:1684 writesame 0x130c10 thru 0x13b79b data_size 0x2(0xab8c bytes) 2024-09-18T00:32:15.207 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:15.206+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:15.227 INFO:teuthology.orchestra.run.smithi081.stdout:1685 write 0xd31f36b thru 0xd31ff3d (0xbd3 bytes) 2024-09-18T00:32:15.230 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout:1690 trunc from 0xd31ff3e to 0x471394c 2024-09-18T00:32:15.263 INFO:teuthology.orchestra.run.smithi081.stdout:1694 writesame 0x87c3904 thru 0x87cc531 data_size 0x3(0x8c2e bytes) 2024-09-18T00:32:15.263 INFO:teuthology.orchestra.run.smithi081.stdout:1695 write 0x1e7c3b7 thru 0x1e83b50 (0x779a bytes) 2024-09-18T00:32:15.265 INFO:teuthology.orchestra.run.smithi081.stdout:1697 write 0x2bca292 thru 0x2bd06bf (0x642e bytes) 2024-09-18T00:32:15.267 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.267 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.267 INFO:teuthology.orchestra.run.smithi081.stdout:1703 read 0x2969d22 thru 0x2973a79 (0x9d58 bytes) 2024-09-18T00:32:15.267 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.268 INFO:teuthology.orchestra.run.smithi081.stdout:1706 write 0x6910706 thru 0x691b6e2 (0xafdd bytes) 2024-09-18T00:32:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:1707 writesame 0xddaa23a thru 0xddb48e2 data_size 0x73(0xa6a9 bytes) 2024-09-18T00:32:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:1708 punch from 0x35b4a2 to 0x36a994, (0xf4f2 bytes) 2024-09-18T00:32:15.289 INFO:teuthology.orchestra.run.smithi081.stdout:1710 trunc from 0xddb48e3 to 0x93eded2 2024-09-18T00:32:15.294 INFO:teuthology.orchestra.run.smithi081.stdout:1711 writesame 0x305b766 thru 0x3066094 data_size 0x1(0xa92f bytes) 2024-09-18T00:32:15.306 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:15.306 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:15.308 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:15.307+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:15.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:15.321 INFO:teuthology.orchestra.run.smithi081.stdout:1712 writesame 0x2410a81 thru 0x24176a5 data_size 0x31(0x6c25 bytes) 2024-09-18T00:32:15.328 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.338 INFO:teuthology.orchestra.run.smithi081.stdout:1715 write 0xec42095 thru 0xec47743 (0x56af bytes) 2024-09-18T00:32:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:1716 read 0xc1ae801 thru 0xc1ba8d3 (0xc0d3 bytes) 2024-09-18T00:32:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:1718 read 0x28330b1 thru 0x283cde3 (0x9d33 bytes) 2024-09-18T00:32:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:1719 write 0x7adf0f5 thru 0x7ae5caf (0x6bbb bytes) 2024-09-18T00:32:15.346 INFO:teuthology.orchestra.run.smithi081.stdout:1720 punch from 0x3fc849a to 0x3fcfb55, (0x76bb bytes) 2024-09-18T00:32:15.346 INFO:teuthology.orchestra.run.smithi081.stdout:1721 punch from 0xd04e85e to 0xd051d82, (0x3524 bytes) 2024-09-18T00:32:15.346 INFO:teuthology.orchestra.run.smithi081.stdout:1722 writesame 0x8d784d thru 0x8dbd80 data_size 0x56(0x4534 bytes) 2024-09-18T00:32:15.352 INFO:teuthology.orchestra.run.smithi081.stdout:1725 trunc from 0xec47744 to 0xa422770 2024-09-18T00:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout:1726 writesame 0x35511c1 thru 0x35559a5 data_size 0xf(0x47e5 bytes) 2024-09-18T00:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout:1728 punch from 0x5cdb7cc to 0x5cdf739, (0x3f6d bytes) 2024-09-18T00:32:15.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:15.376 INFO:teuthology.orchestra.run.smithi081.stdout:1729 trunc from 0xa422770 to 0xd87198 2024-09-18T00:32:15.389 INFO:teuthology.orchestra.run.smithi081.stdout:1732 read 0x37cb71 thru 0x37dce4 (0x1174 bytes) 2024-09-18T00:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout:1735 trunc from 0xd87198 to 0xadd39b1 2024-09-18T00:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:1738 read 0x3124e0b thru 0x312601a (0x1210 bytes) 2024-09-18T00:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout:1739 write 0x536d875 thru 0x537ba02 (0xe18e bytes) 2024-09-18T00:32:15.409 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:15.407+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout:1741 write 0x3e75a68 thru 0x3e79c08 (0x41a1 bytes) 2024-09-18T00:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout:1742 writesame 0xad24a7c thru 0xad28287 data_size 0x22(0x380c bytes) 2024-09-18T00:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.424 INFO:teuthology.orchestra.run.smithi081.stdout:1746 trunc from 0xadd39b1 to 0x7860083 2024-09-18T00:32:15.435 INFO:teuthology.orchestra.run.smithi081.stdout:1747 writesame 0x10898c8 thru 0x108fd7d data_size 0x3(0x64b6 bytes) 2024-09-18T00:32:15.441 INFO:teuthology.orchestra.run.smithi081.stdout:1748 punch from 0x2eaa9a2 to 0x2eab694, (0xcf2 bytes) 2024-09-18T00:32:15.442 INFO:teuthology.orchestra.run.smithi081.stdout:1749 punch from 0x593e610 to 0x594e4ff, (0xfeef bytes) 2024-09-18T00:32:15.442 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:15.442 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:15.449 INFO:teuthology.orchestra.run.smithi081.stdout:1750 trunc from 0x7860083 to 0xda5c489 2024-09-18T00:32:15.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:15.467 INFO:teuthology.orchestra.run.smithi081.stdout:1751 trunc from 0xda5c489 to 0x298ff13 2024-09-18T00:32:15.484 INFO:teuthology.orchestra.run.smithi081.stdout:1752 read 0xbc433a thru 0xbcaee6 (0x6bad bytes) 2024-09-18T00:32:15.484 INFO:teuthology.orchestra.run.smithi081.stdout:1753 punch from 0x40161b to 0x40b496, (0x9e7b bytes) 2024-09-18T00:32:15.491 INFO:teuthology.orchestra.run.smithi081.stdout:1754 trunc from 0x298ff13 to 0x764fcb6 2024-09-18T00:32:15.496 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.496 INFO:teuthology.orchestra.run.smithi081.stdout:1757 read 0x384dfbe thru 0x3859b9a (0xbbdd bytes) 2024-09-18T00:32:15.506 INFO:teuthology.orchestra.run.smithi081.stdout:1758 writesame 0xa9e243f thru 0xa9f0d2e data_size 0x8(0xe8f0 bytes) 2024-09-18T00:32:15.510 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:15.508+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:15.511 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:15.518 INFO:teuthology.orchestra.run.smithi081.stdout:1759 trunc from 0xa9f0d2f to 0x8bfe0e 2024-09-18T00:32:15.525 INFO:teuthology.orchestra.run.smithi081.stdout:1762 read 0x26dfc6 thru 0x274d07 (0x6d42 bytes) 2024-09-18T00:32:15.531 INFO:teuthology.orchestra.run.smithi081.stdout:1763 writesame 0xb77019 thru 0xb7950c data_size 0x37(0x24f4 bytes) 2024-09-18T00:32:15.532 INFO:teuthology.orchestra.run.smithi081.stdout:1766 trunc from 0xb7950d to 0x77ef49 2024-09-18T00:32:15.535 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:15.546 INFO:teuthology.orchestra.run.smithi081.stdout:1767 write 0x1d53cac thru 0x1d5dce4 (0xa039 bytes) 2024-09-18T00:32:15.547 INFO:teuthology.orchestra.run.smithi081.stdout:1769 punch from 0x1452063 to 0x1456902, (0x489f bytes) 2024-09-18T00:32:15.548 INFO:teuthology.orchestra.run.smithi081.stdout:1770 punch from 0x8a8e21 to 0x8b2bad, (0x9d8c bytes) 2024-09-18T00:32:15.548 INFO:teuthology.orchestra.run.smithi081.stdout:1771 punch from 0x16af9f8 to 0x16b9b5a, (0xa162 bytes) 2024-09-18T00:32:15.553 INFO:teuthology.orchestra.run.smithi081.stdout:1772 writesame 0x201bd83 thru 0x201f68e data_size 0x6(0x390c bytes) 2024-09-18T00:32:15.554 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.554 INFO:teuthology.orchestra.run.smithi081.stdout:1776 read 0xc826f0 thru 0xc85014 (0x2925 bytes) 2024-09-18T00:32:15.555 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:15.556 INFO:teuthology.orchestra.run.smithi081.stdout:1777 trunc from 0x201f68f to 0xfd967b 2024-09-18T00:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout:1778 read 0x912674 thru 0x91b001 (0x898e bytes) 2024-09-18T00:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:15.574 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout:1780 write 0x8e45a02 thru 0x8e551e7 (0xf7e6 bytes) 2024-09-18T00:32:15.592 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:15.592 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:15.592 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:15.592 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:15.593 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:15.593 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:15.594 INFO:teuthology.orchestra.run.smithi081.stdout:1781 write 0xe27cfe4 thru 0xe28a399 (0xd3b6 bytes) 2024-09-18T00:32:15.599 INFO:teuthology.orchestra.run.smithi081.stdout:1782 write 0x2532bce thru 0x2536646 (0x3a79 bytes) 2024-09-18T00:32:15.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:15.615 INFO:teuthology.orchestra.run.smithi081.stdout:1783 trunc from 0xe28a39a to 0x3b08b6a 2024-09-18T00:32:15.616 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:15.614+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:15.619 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:1784 write 0x7a983c7 thru 0x7aa614f (0xdd89 bytes) 2024-09-18T00:32:15.641 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:15.641 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:15.646 INFO:teuthology.orchestra.run.smithi081.stdout:1786 write 0x7ac9052 thru 0x7ad8555 (0xf504 bytes) 2024-09-18T00:32:15.656 INFO:teuthology.orchestra.run.smithi081.stdout:1790 write 0xaa1119c thru 0xaa2081c (0xf681 bytes) 2024-09-18T00:32:15.660 INFO:teuthology.orchestra.run.smithi081.stdout:1791 punch from 0x7f59f2f to 0x7f5a304, (0x3d5 bytes) 2024-09-18T00:32:15.660 INFO:teuthology.orchestra.run.smithi081.stdout:1793 write 0x19f02f8 thru 0x19f116b (0xe74 bytes) 2024-09-18T00:32:15.661 INFO:teuthology.orchestra.run.smithi081.stdout:1794 write 0x1acc769 thru 0x1ad7f61 (0xb7f9 bytes) 2024-09-18T00:32:15.661 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:15.661 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:15.663 INFO:teuthology.orchestra.run.smithi081.stdout:1795 write 0x8653629 thru 0x86559c3 (0x239b bytes) 2024-09-18T00:32:15.666 INFO:teuthology.orchestra.run.smithi081.stdout:1797 punch from 0x30e6d96 to 0x30ef3af, (0x8619 bytes) 2024-09-18T00:32:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:1798 writesame 0xc6b0f53 thru 0xc6b114f data_size 0x1(0x1fd bytes) 2024-09-18T00:32:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:1799 punch from 0x123a850 to 0x123b96a, (0x111a bytes) 2024-09-18T00:32:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:1801 punch from 0xb7cc4c1 to 0xb7d41eb, (0x7d2a bytes) 2024-09-18T00:32:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:1804 punch from 0x9ead39a to 0x9eb0226, (0x2e8c bytes) 2024-09-18T00:32:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:1806 trunc from 0xc6b1150 to 0x88cbb0 2024-09-18T00:32:15.699 INFO:teuthology.orchestra.run.smithi081.stdout:1808 punch from 0x784e4c to 0x7868a0, (0x1a54 bytes) 2024-09-18T00:32:15.704 INFO:teuthology.orchestra.run.smithi081.stdout:1809 write 0x97649c thru 0x9841f7 (0xdd5c bytes) 2024-09-18T00:32:15.711 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:15.710+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:15.716 INFO:teuthology.orchestra.run.smithi081.stdout:1810 writesame 0x4646c08 thru 0x4650419 data_size 0x11(0x9812 bytes) 2024-09-18T00:32:15.718 INFO:teuthology.orchestra.run.smithi081.stdout:1812 trunc from 0x465041a to 0x6184ff6 2024-09-18T00:32:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:1813 writesame 0x2e7619a thru 0x2e802a0 data_size 0x5b(0xa107 bytes) 2024-09-18T00:32:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:1815 writesame 0x1491b83 thru 0x14990c9 data_size 0x1(0x7547 bytes) 2024-09-18T00:32:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:15.734 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:15.734 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:15.734 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:15.734 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:15.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:15.749 INFO:teuthology.orchestra.run.smithi081.stdout:1816 read 0x3e51214 thru 0x3e5e5cc (0xd3b9 bytes) 2024-09-18T00:32:15.764 INFO:teuthology.orchestra.run.smithi081.stdout:1818 write 0xddd6bd3 thru 0xdde0ff3 (0xa421 bytes) 2024-09-18T00:32:15.770 INFO:teuthology.orchestra.run.smithi081.stdout:1819 trunc from 0xdde0ff4 to 0xbdf8091 2024-09-18T00:32:15.780 INFO:teuthology.orchestra.run.smithi081.stdout:1820 punch from 0x7197fa3 to 0x71a3f87, (0xbfe4 bytes) 2024-09-18T00:32:15.780 INFO:teuthology.orchestra.run.smithi081.stdout:1822 write 0x42a70a9 thru 0x42ac07c (0x4fd4 bytes) 2024-09-18T00:32:15.781 INFO:teuthology.orchestra.run.smithi081.stdout:1823 read 0x781cf88 thru 0x78235b6 (0x662f bytes) 2024-09-18T00:32:15.792 INFO:teuthology.orchestra.run.smithi081.stdout:1827 trunc from 0xbdf8091 to 0x322150f 2024-09-18T00:32:15.799 INFO:teuthology.orchestra.run.smithi081.stdout:1829 read 0x27b3d0e thru 0x27b4d43 (0x1036 bytes) 2024-09-18T00:32:15.799 INFO:teuthology.orchestra.run.smithi081.stdout:1831 read 0x125d7be thru 0x126cf90 (0xf7d3 bytes) 2024-09-18T00:32:15.800 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.800 INFO:teuthology.orchestra.run.smithi081.stdout:1834 read 0x1650d05 thru 0x165ec98 (0xdf94 bytes) 2024-09-18T00:32:15.800 INFO:teuthology.orchestra.run.smithi081.stdout:1835 read 0x288b482 thru 0x2899266 (0xdde5 bytes) 2024-09-18T00:32:15.800 INFO:teuthology.orchestra.run.smithi081.stdout:1836 read 0x2901904 thru 0x290a6a2 (0x8d9f bytes) 2024-09-18T00:32:15.801 INFO:teuthology.orchestra.run.smithi081.stdout:1837 punch from 0x2bc8b8d to 0x2bca595, (0x1a08 bytes) 2024-09-18T00:32:15.801 INFO:teuthology.orchestra.run.smithi081.stdout:1839 read 0x23abe71 thru 0x23bbb3a (0xfcca bytes) 2024-09-18T00:32:15.812 INFO:teuthology.orchestra.run.smithi081.stdout:1843 trunc from 0x322150f to 0xc7f26f7 2024-09-18T00:32:15.812 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:15.811+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:15.817 INFO:teuthology.orchestra.run.smithi081.stdout:1844 write 0xa2af88e thru 0xa2b7132 (0x78a5 bytes) 2024-09-18T00:32:15.820 INFO:teuthology.orchestra.run.smithi081.stdout:1846 write 0x452249b thru 0x4530547 (0xe0ad bytes) 2024-09-18T00:32:15.822 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.825 INFO:teuthology.orchestra.run.smithi081.stdout:1849 trunc from 0xc7f26f7 to 0x969b3ef 2024-09-18T00:32:15.835 INFO:teuthology.orchestra.run.smithi081.stdout:1850 write 0x6eec440 thru 0x6efba24 (0xf5e5 bytes) 2024-09-18T00:32:15.837 INFO:teuthology.orchestra.run.smithi081.stdout:1852 read 0x38e8a8e thru 0x38f82b4 (0xf827 bytes) 2024-09-18T00:32:15.844 INFO:teuthology.orchestra.run.smithi081.stdout:1853 trunc from 0x969b3ef to 0x4248728 2024-09-18T00:32:15.855 INFO:teuthology.orchestra.run.smithi081.stdout:1854 read 0x32e0b92 thru 0x32e51d6 (0x4645 bytes) 2024-09-18T00:32:15.865 INFO:teuthology.orchestra.run.smithi081.stdout:1855 trunc from 0x4248728 to 0xc88b81e 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39869 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 137216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:15.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.4001200649999999, 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017016, 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39869 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:15.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2e-07 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468604+0000", 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.03e-06 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468610+0000", 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8069999999999996e-06 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468615+0000", 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485472+0000", 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016857647 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485541+0000", 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8960000000000004e-05 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485618+0000", 2024-09-18T00:32:15.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6377000000000004e-05 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.4000813440000002, 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:15.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:32:15.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.399790629, 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.881 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:32:15.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.39974417, 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:32:15.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3997206740000001, 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:32:15.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:32:15.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3996981690000001, 2024-09-18T00:32:15.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:32:15.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.399188219, 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:32:15.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.399138131, 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:32:15.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3991067610000001, 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.399084674, 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.399062636, 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:32:15.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39892 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3979353809999999, 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016967862, 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39892 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1800000000000004e-07 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470792+0000", 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2030000000000002e-06 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470802+0000", 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0484e-05 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470810+0000", 2024-09-18T00:32:15.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5299999999999999e-06 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487600+0000", 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016790474999999999 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487673+0000", 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2689999999999997e-05 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487754+0000", 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1562000000000003e-05 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3979006140000001, 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:32:15.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:32:15.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:15.931 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3978692939999999, 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3978374979999999, 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:32:15.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3978123870000001, 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:32:15.940 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:32:15.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:32:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3977689199999999, 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:32:15.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:32:15.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.949 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.3977470329999999, 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:32:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:32:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.397689755, 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:32:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:32:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.397662666, 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:32:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:15.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:15.964 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:15.965 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.965 INFO:teuthology.orchestra.run.smithi081.stdout:1857 write 0x2e8912d thru 0x2e93b2b (0xa9ff bytes) 2024-09-18T00:32:15.965 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.965 INFO:teuthology.orchestra.run.smithi081.stdout:1859 read 0x5ce29 thru 0x6140c (0x45e4 bytes) 2024-09-18T00:32:15.965 INFO:teuthology.orchestra.run.smithi081.stdout:1860 writesame 0x1b9bb02 thru 0x1ba8298 data_size 0xb(0xc797 bytes) 2024-09-18T00:32:15.966 INFO:teuthology.orchestra.run.smithi081.stdout:1862 write 0xf2b0c4 thru 0xf2dcbd (0x2bfa bytes) 2024-09-18T00:32:15.966 INFO:teuthology.orchestra.run.smithi081.stdout:1863 punch from 0x33bb3c0 to 0x33c9960, (0xe5a0 bytes) 2024-09-18T00:32:15.966 INFO:teuthology.orchestra.run.smithi081.stdout:1866 punch from 0xa1ab3f2 to 0xa1b9d58, (0xe966 bytes) 2024-09-18T00:32:15.966 INFO:teuthology.orchestra.run.smithi081.stdout:1867 punch from 0x83ebe23 to 0x83fabed, (0xedca bytes) 2024-09-18T00:32:15.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:15.969 INFO:teuthology.orchestra.run.smithi081.stdout:1868 trunc from 0xc88b81e to 0x95efb79 2024-09-18T00:32:15.969 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1871 write 0x480fe57 thru 0x481ab7c (0xad26 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1872 trunc from 0x95efb79 to 0x5cba842 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1874 writesame 0x5cbc6b9 thru 0x5cc5e69 data_size 0x1(0x97b1 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1877 write 0xabc4600 thru 0xabcc26b (0x7c6c bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1878 writesame 0x988c33b thru 0x98955f5 data_size 0x13(0x92bb bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1880 writesame 0x3e6054e thru 0x3e61141 data_size 0x33(0xbf4 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1881 read 0x98acfa2 thru 0x98b652c (0x958b bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1882 punch from 0x29c6620 to 0x29c6c62, (0x642 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1884 read 0x963f3a2 thru 0x9645f66 (0x6bc5 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1885 write 0xd71bdb5 thru 0xd72753b (0xb787 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1886 writesame 0x17eb479 thru 0x17fa090 data_size 0x14(0xec18 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1887 punch from 0x2a102a4 to 0x2a187e2, (0x853e bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1888 write 0x88bb053 thru 0x88c6ebb (0xbe69 bytes) 2024-09-18T00:32:15.970 INFO:teuthology.orchestra.run.smithi081.stdout:1889 writesame 0x3fbda93 thru 0x3fc8390 data_size 0x61(0xa8fe bytes) 2024-09-18T00:32:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:1890 read 0x25deb39 thru 0x25dfd28 (0x11f0 bytes) 2024-09-18T00:32:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:1892 write 0x7e8ebec thru 0x7e95d27 (0x713c bytes) 2024-09-18T00:32:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:1893 write 0xe7fc5c5 thru 0xe809fa3 (0xd9df bytes) 2024-09-18T00:32:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:1894 writesame 0xb3244d4 thru 0xb32e0fa data_size 0x4b(0x9c27 bytes) 2024-09-18T00:32:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:1895 trunc from 0xe809fa4 to 0xbede7c1 2024-09-18T00:32:15.971 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:15.967+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:15.977 INFO:teuthology.orchestra.run.smithi081.stdout:1896 punch from 0x75c87ed to 0x75ca266, (0x1a79 bytes) 2024-09-18T00:32:15.977 INFO:teuthology.orchestra.run.smithi081.stdout:1897 read 0x7df7e46 thru 0x7df867b (0x836 bytes) 2024-09-18T00:32:15.977 INFO:teuthology.orchestra.run.smithi081.stdout:1898 write 0x4cc3a75 thru 0x4ccf084 (0xb610 bytes) 2024-09-18T00:32:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:1899 read 0x3f3185 thru 0x4024f3 (0xf36f bytes) 2024-09-18T00:32:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:32:15.989 INFO:teuthology.orchestra.run.smithi081.stdout:1901 trunc from 0xbede7c1 to 0x417b850 2024-09-18T00:32:16.005 INFO:teuthology.orchestra.run.smithi081.stdout:1902 punch from 0xc30893 to 0xc35c25, (0x5392 bytes) 2024-09-18T00:32:16.005 INFO:teuthology.orchestra.run.smithi081.stdout:1903 read 0x3a0b9a8 thru 0x3a1568b (0x9ce4 bytes) 2024-09-18T00:32:16.005 INFO:teuthology.orchestra.run.smithi081.stdout:1904 write 0x22f36cf thru 0x23020ef (0xea21 bytes) 2024-09-18T00:32:16.021 INFO:teuthology.orchestra.run.smithi081.stdout:1905 write 0xbf401f7 thru 0xbf436b9 (0x34c3 bytes) 2024-09-18T00:32:16.026 INFO:teuthology.orchestra.run.smithi081.stdout:1907 write 0x4427923 thru 0x44302bb (0x8999 bytes) 2024-09-18T00:32:16.028 INFO:teuthology.orchestra.run.smithi081.stdout:1908 read 0x871ee91 thru 0x8724864 (0x59d4 bytes) 2024-09-18T00:32:16.029 INFO:teuthology.orchestra.run.smithi081.stdout:1909 punch from 0x5634366 to 0x563a0f2, (0x5d8c bytes) 2024-09-18T00:32:16.034 INFO:teuthology.orchestra.run.smithi081.stdout:1910 write 0xc9fe3a2 thru 0xc9feb8d (0x7ec bytes) 2024-09-18T00:32:16.037 INFO:teuthology.orchestra.run.smithi081.stdout:1911 read 0x2064170 thru 0x206c2de (0x816f bytes) 2024-09-18T00:32:16.037 INFO:teuthology.orchestra.run.smithi081.stdout:1913 write 0x6c37032 thru 0x6c3d406 (0x63d5 bytes) 2024-09-18T00:32:16.040 INFO:teuthology.orchestra.run.smithi081.stdout:1914 write 0x32fac3a thru 0x32fe280 (0x3647 bytes) 2024-09-18T00:32:16.042 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:16.049 INFO:teuthology.orchestra.run.smithi081.stdout:1916 write 0xe87a331 thru 0xe8825e6 (0x82b6 bytes) 2024-09-18T00:32:16.053 INFO:teuthology.orchestra.run.smithi081.stdout:1918 write 0xd2aa7fd thru 0xd2b7e5c (0xd660 bytes) 2024-09-18T00:32:16.056 INFO:teuthology.orchestra.run.smithi081.stdout:1920 write 0x7fd8e65 thru 0x7fdfc93 (0x6e2f bytes) 2024-09-18T00:32:16.059 INFO:teuthology.orchestra.run.smithi081.stdout:1921 writesame 0x9206f67 thru 0x920dca7 data_size 0x1(0x6d41 bytes) 2024-09-18T00:32:16.069 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:16.067+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:16.083 INFO:teuthology.orchestra.run.smithi081.stdout:1923 trunc from 0xe8825e7 to 0x777b9b1 2024-09-18T00:32:16.094 INFO:teuthology.orchestra.run.smithi081.stdout:1924 punch from 0x59264e0 to 0x592974b, (0x326b bytes) 2024-09-18T00:32:16.094 INFO:teuthology.orchestra.run.smithi081.stdout:1926 punch from 0x32a1988 to 0x32aa626, (0x8c9e bytes) 2024-09-18T00:32:16.096 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.096 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:16.097 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:16.097 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.101 INFO:teuthology.orchestra.run.smithi081.stdout:1927 trunc from 0x777b9b1 to 0x1a2a075 2024-09-18T00:32:16.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:16.117 INFO:teuthology.orchestra.run.smithi081.stdout:1928 trunc from 0x1a2a075 to 0x472cd8 2024-09-18T00:32:16.135 INFO:teuthology.orchestra.run.smithi081.stdout:1929 trunc from 0x472cd8 to 0xa2101c8 2024-09-18T00:32:16.140 INFO:teuthology.orchestra.run.smithi081.stdout:1932 write 0x35a656 thru 0x362565 (0x7f10 bytes) 2024-09-18T00:32:16.149 INFO:teuthology.orchestra.run.smithi081.stdout:1935 write 0xbe35c74 thru 0xbe367c9 (0xb56 bytes) 2024-09-18T00:32:16.152 INFO:teuthology.orchestra.run.smithi081.stdout:1936 punch from 0x308eccd to 0x3094dbb, (0x60ee bytes) 2024-09-18T00:32:16.152 INFO:teuthology.orchestra.run.smithi081.stdout:1937 write 0x39dec28 thru 0x39e29ec (0x3dc5 bytes) 2024-09-18T00:32:16.155 INFO:teuthology.orchestra.run.smithi081.stdout:1938 punch from 0x5dcc78 to 0x5e21cd, (0x5555 bytes) 2024-09-18T00:32:16.155 INFO:teuthology.orchestra.run.smithi081.stdout:1939 writesame 0x1109b77 thru 0x110f506 data_size 0x8(0x5990 bytes) 2024-09-18T00:32:16.158 INFO:teuthology.orchestra.run.smithi081.stdout:1940 read 0xb575922 thru 0xb5775e7 (0x1cc6 bytes) 2024-09-18T00:32:16.158 INFO:teuthology.orchestra.run.smithi081.stdout:1943 write 0x4cf86ac thru 0x4cfb01b (0x2970 bytes) 2024-09-18T00:32:16.161 INFO:teuthology.orchestra.run.smithi081.stdout:1944 write 0x632375d thru 0x633134b (0xdbef bytes) 2024-09-18T00:32:16.164 INFO:teuthology.orchestra.run.smithi081.stdout:1945 clone 18 order 21 su 65536 sc 15 2024-09-18T00:32:16.170 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:16.168+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:16.225 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:16.225 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:16.270 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:16.269+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:16.372 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:16.370+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:16.378 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.378 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:16.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:16.378 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:16.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.841150899999999, 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.696764443999999, 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:32:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:16.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:32:16.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.671447615000002, 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.388 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:32:16.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:15867 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'43, mlcod=39'40)", 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.926632786999999, 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036878850000000001, 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449668+0000", 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9999999999999997e-07 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449673+0000", 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0950000000000003e-06 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449685+0000", 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2313999999999999e-05 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449691+0000", 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2770000000000002e-06 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449733+0000", 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2131e-05 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449752+0000", 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8987999999999998e-05 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453326+0000", 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035735290000000002 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453355+0000", 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8951000000000001e-05 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:16.397 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.547583196, 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:32:16.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16281 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'55, mlcod=39'52)", 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.547008475, 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034366890000000001, 2024-09-18T00:32:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829292+0000", 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9800000000000003e-07 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829297+0000", 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2449999999999998e-06 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829310+0000", 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2649999999999999e-05 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829317+0000", 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8669999999999996e-06 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829366+0000", 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9604000000000001e-05 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829384+0000", 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7445e-05 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832703+0000", 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033195400000000002 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832728+0000", 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4640000000000001e-05 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16279 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'68, mlcod=39'65)", 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.546950332, 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033756509999999999, 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829354+0000", 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2069999999999997e-06 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829363+0000", 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4209999999999995e-06 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829368+0000", 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4909999999999996e-06 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829413+0000", 2024-09-18T00:32:16.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4830000000000003e-05 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829430+0000", 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7221e-05 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832693+0000", 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003262764 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832725+0000", 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2298000000000001e-05 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.468874509999999, 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.411 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:32:16.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.468718225, 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:32:16.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.468533901000001, 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:16.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:32:16.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:32:16.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:32:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.3504155480000009, 2024-09-18T00:32:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:32:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:16.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:16.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:32:16.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:32:16.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:32:16.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:32:16.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:32:16.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:32:16.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:32:16.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.192242126, 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:16.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:32:16.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:32:16.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:32:16.439 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1912641920000002, 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:16.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:32:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1905375800000009, 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:32:16.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.3066908149999996, 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:32:16.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.3056489249999998, 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:32:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:32:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:32:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.3006242380000002, 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:32:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:36736 3.0 e47/23 3:06bbb605:::rbd_data.1197120e014.0000000000000033:head v 47'145, mlcod=47'143)", 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.290015+0000", 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.0862846959999999, 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033666910000000002, 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290015+0000", 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290015+0000", 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290016+0000", 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8999999999999996e-07 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290023+0000", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8589999999999999e-06 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290036+0000", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3268000000000001e-05 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290043+0000", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.075e-06 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290109+0000", 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6173000000000005e-05 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.290133+0000", 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4159999999999999e-05 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.293340+0000", 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032061759999999998 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.293382+0000", 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2290000000000003e-05 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7614064539999998, 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.468 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:32:16.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:32:16.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:43083 3.9 e48/23 3:978a70df:::rbd_data.1197f8e02b0b.0000000000000048:head v 48'175, mlcod=47'173)", 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.243536084, 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003735454, 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132766+0000", 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133785+0000", 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010192280000000001 2024-09-18T00:32:16.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133805+0000", 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0177999999999999e-05 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133817+0000", 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1430000000000001e-05 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133886+0000", 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9220000000000005e-05 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133905+0000", 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8698999999999998e-05 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.136451+0000", 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025461669999999998 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.136499+0000", 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8507000000000002e-05 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.477 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:16.480 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:16.477+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:16.560 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:16.561 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:16.561 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-18T00:32:16.561 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T00:32:16.561 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T00:32:16.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-18T00:32:16.579 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:16.577+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:16.627 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.627 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:16.627 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:16.627 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:16.668 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.668 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T00:32:16.668 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.679 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:16.678+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:16.740 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.740 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:16.740 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:16.740 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:16.740 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:16.791 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:16.790+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:16.853 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.882789704, 2024-09-18T00:32:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:16.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:16.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:16.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:16.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:16.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:16.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:16.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:16.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:16.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:16.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:16.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:16.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:16.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.863 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.864 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:16.864 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.882410047, 2024-09-18T00:32:16.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:16.864 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:16.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:16.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:16.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:16.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:16.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:16.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:16.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:16.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:16.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:16.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:16.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:16.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:16.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:16.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:16.874 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.881580864, 2024-09-18T00:32:16.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:16.875 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:16.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.876 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:16.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:16.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:16.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.882 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.874796261, 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:16.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.874775795000001, 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:16.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:16.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:16.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.874751706000001, 2024-09-18T00:32:16.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:16.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.872905744000001, 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:16.897 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:16.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.872841924999999, 2024-09-18T00:32:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:16.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.872813045000001, 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.872788068999999, 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:16.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.872769017, 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:16.916 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:16.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.870820219999999, 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.870797762999999, 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.870769323000001, 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:16.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.870747014999999, 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:16.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.870726563000002, 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:16.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:16.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.869897114, 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.869856189, 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.869814942000001, 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:16.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.869792276999998, 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:16.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:16.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:16.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:16.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:16.962 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:16.963 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:16.964 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:16.961+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:17.050 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone17 from 0xbe367ca (overlap 0x472cd8) to 0x0 2024-09-18T00:32:17.064 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:17.062+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:17.086 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:17.087 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:17.087 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:17.087 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:17.096 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:17.097 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-18T00:32:17.165 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:17.163+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:17.210 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:17.211 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:17.211 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:17.211 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:17.211 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:17.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:17.303 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:17.302+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:17.364 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2175168589999998, 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.365 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:17.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2174963959999996, 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:17.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:17.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2174770009999998, 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:17.374 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:17.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2174578460000003, 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:17.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2174384160000002, 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.383 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:17.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:17.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.387 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2174187610000002, 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:17.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:17.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2173997669999999, 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.392 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:17.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:17.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:17.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2173608419999997, 2024-09-18T00:32:17.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2173407620000001, 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2173210179999998, 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2173012390000002, 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2172816510000004, 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2172521849999995, 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2172218519999998, 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2171951219999997, 2024-09-18T00:32:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2171677250000004, 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2171420819999996, 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2171171760000004, 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2170830050000001, 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 5.2170450849999996, 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.457 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:17.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:17.460 INFO:teuthology.orchestra.run.smithi081.stdout:1946 punch from 0x19ab2e4 to 0x19b058c, (0x52a8 bytes) 2024-09-18T00:32:17.460 INFO:teuthology.orchestra.run.smithi081.stdout:1947 writesame 0xd475297 thru 0xd484c5b data_size 0x1(0xf9c5 bytes) 2024-09-18T00:32:17.460 INFO:teuthology.orchestra.run.smithi081.stdout:1948 punch from 0x5009398 to 0x501644b, (0xd0b3 bytes) 2024-09-18T00:32:17.460 INFO:teuthology.orchestra.run.smithi081.stdout:1949 read 0x39d88b5 thru 0x39e4fce (0xc71a bytes) 2024-09-18T00:32:17.460 INFO:teuthology.orchestra.run.smithi081.stdout:1950 punch from 0x16e3693 to 0x16ed05b, (0x99c8 bytes) 2024-09-18T00:32:17.461 INFO:teuthology.orchestra.run.smithi081.stdout:1951 writesame 0x5b45cc4 thru 0x5b47df3 data_size 0x24(0x2130 bytes) 2024-09-18T00:32:17.461 INFO:teuthology.orchestra.run.smithi081.stdout:1952 writesame 0x273f55b thru 0x274d28a data_size 0x8(0xdd30 bytes) 2024-09-18T00:32:17.461 INFO:teuthology.orchestra.run.smithi081.stdout:1953 read 0x867172a thru 0x8674bce (0x34a5 bytes) 2024-09-18T00:32:17.461 INFO:teuthology.orchestra.run.smithi081.stdout:1954 write 0xd07cc10 thru 0xd084cdc (0x80cd bytes) 2024-09-18T00:32:17.461 INFO:teuthology.orchestra.run.smithi081.stdout:1955 trunc from 0xd484c5c to 0xb338c86 2024-09-18T00:32:17.461 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:17.457+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:17.466 INFO:teuthology.orchestra.run.smithi081.stdout:1957 punch from 0x6e7dbb1 to 0x6e805c6, (0x2a15 bytes) 2024-09-18T00:32:17.473 INFO:teuthology.orchestra.run.smithi081.stdout:1958 trunc from 0xb338c86 to 0x53fad30 2024-09-18T00:32:17.503 INFO:teuthology.orchestra.run.smithi081.stdout:1960 write 0x63e860 thru 0x642d3c (0x44dd bytes) 2024-09-18T00:32:17.514 INFO:teuthology.orchestra.run.smithi081.stdout:1961 trunc from 0x53fad30 to 0x3429f6d 2024-09-18T00:32:17.547 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.547 INFO:teuthology.orchestra.run.smithi081.stdout:1964 read 0x74f50c thru 0x754be7 (0x56dc bytes) 2024-09-18T00:32:17.547 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.547 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.548 INFO:teuthology.orchestra.run.smithi081.stdout:1968 punch from 0x2357905 to 0x235a154, (0x284f bytes) 2024-09-18T00:32:17.560 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:17.558+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:17.566 INFO:teuthology.orchestra.run.smithi081.stdout:1972 writesame 0xe485ced thru 0xe48e3fb data_size 0x19(0x870f bytes) 2024-09-18T00:32:17.566 INFO:teuthology.orchestra.run.smithi081.stdout:1974 writesame 0x2f225ca thru 0x2f2ca10 data_size 0xd(0xa447 bytes) 2024-09-18T00:32:17.570 INFO:teuthology.orchestra.run.smithi081.stdout:1975 write 0x5514444 thru 0x551f4bd (0xb07a bytes) 2024-09-18T00:32:17.574 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.574 INFO:teuthology.orchestra.run.smithi081.stdout:1977 punch from 0x9d429e4 to 0x9d4e2e1, (0xb8fd bytes) 2024-09-18T00:32:17.575 INFO:teuthology.orchestra.run.smithi081.stdout:1979 write 0x70d3bbe thru 0x70d7bfd (0x4040 bytes) 2024-09-18T00:32:17.577 INFO:teuthology.orchestra.run.smithi081.stdout:1980 punch from 0x15f0a31 to 0x15f2f97, (0x2566 bytes) 2024-09-18T00:32:17.577 INFO:teuthology.orchestra.run.smithi081.stdout:1981 writesame 0x260182b thru 0x2608aa7 data_size 0x35(0x727d bytes) 2024-09-18T00:32:17.579 INFO:teuthology.orchestra.run.smithi081.stdout:1982 trunc from 0xe48e3fc to 0xe0b3f9e 2024-09-18T00:32:17.584 INFO:teuthology.orchestra.run.smithi081.stdout:1983 write 0xbc04725 thru 0xbc12d3f (0xe61b bytes) 2024-09-18T00:32:17.595 INFO:teuthology.orchestra.run.smithi081.stdout:1984 read 0xd090a1a thru 0xd09a4df (0x9ac6 bytes) 2024-09-18T00:32:17.596 INFO:teuthology.orchestra.run.smithi081.stdout:1985 punch from 0x44435b7 to 0x444892f, (0x5378 bytes) 2024-09-18T00:32:17.596 INFO:teuthology.orchestra.run.smithi081.stdout:1986 punch from 0x103892 to 0x106973, (0x30e1 bytes) 2024-09-18T00:32:17.596 INFO:teuthology.orchestra.run.smithi081.stdout:1987 write 0x2bab79b thru 0x2baffce (0x4834 bytes) 2024-09-18T00:32:17.597 INFO:teuthology.orchestra.run.smithi081.stdout:1990 punch from 0x67806e1 to 0x6789bb5, (0x94d4 bytes) 2024-09-18T00:32:17.597 INFO:teuthology.orchestra.run.smithi081.stdout:1991 write 0x9efdd6e thru 0x9f0aa16 (0xcca9 bytes) 2024-09-18T00:32:17.600 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.601 INFO:teuthology.orchestra.run.smithi081.stdout:1993 writesame 0x8fb7220 thru 0x8fb98ef data_size 0x48(0x26d0 bytes) 2024-09-18T00:32:17.617 INFO:teuthology.orchestra.run.smithi081.stdout:1997 trunc from 0xe0b3f9e to 0x32b273b 2024-09-18T00:32:17.617 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:17.617 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:17.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:55697 3.5 3.224723a5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:17.616602+0000", 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.0037000000000001e-05, 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0535000000000001e-05, 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 55697 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:17.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616602+0000", 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616602+0000", 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616603+0000", 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9400000000000004e-07 2024-09-18T00:32:17.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616608+0000", 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8740000000000003e-06 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616618+0000", 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0682e-05 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616624+0000", 2024-09-18T00:32:17.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5180000000000004e-06 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:17.616692+0000", 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8242000000000002e-05 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 1 2024-09-18T00:32:17.621 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:17.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:17.632 INFO:teuthology.orchestra.run.smithi081.stdout:1998 trunc from 0x32b273b to 0x453cb31 2024-09-18T00:32:17.638 INFO:teuthology.orchestra.run.smithi081.stdout:1999 punch from 0x179b211 to 0x17a612c, (0xaf1b bytes) 2024-09-18T00:32:17.638 INFO:teuthology.orchestra.run.smithi081.stdout:2000 write 0x4248d90 thru 0x4257e2d (0xf09e bytes) 2024-09-18T00:32:17.644 INFO:teuthology.orchestra.run.smithi081.stdout:2002 writesame 0x295f3b8 thru 0x296d579 data_size 0x4a(0xe1c2 bytes) 2024-09-18T00:32:17.661 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:17.659+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:17.662 INFO:teuthology.orchestra.run.smithi081.stdout:2003 write 0xe375f4b thru 0xe37971d (0x37d3 bytes) 2024-09-18T00:32:17.665 INFO:teuthology.orchestra.run.smithi081.stdout:2004 writesame 0x887f182 thru 0x888b045 data_size 0x3a(0xbec4 bytes) 2024-09-18T00:32:17.671 INFO:teuthology.orchestra.run.smithi081.stdout:2006 punch from 0x54c246e to 0x54c7dd6, (0x5968 bytes) 2024-09-18T00:32:17.672 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.672 INFO:teuthology.orchestra.run.smithi081.stdout:2009 read 0x73803f7 thru 0x73869ca (0x65d4 bytes) 2024-09-18T00:32:17.672 INFO:teuthology.orchestra.run.smithi081.stdout:2010 write 0xd596c8d thru 0xd5986e5 (0x1a59 bytes) 2024-09-18T00:32:17.674 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.674 INFO:teuthology.orchestra.run.smithi081.stdout:2014 write 0x960d16b thru 0x96192ec (0xc182 bytes) 2024-09-18T00:32:17.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:17.679 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.684 INFO:teuthology.orchestra.run.smithi081.stdout:2016 trunc from 0xe37971e to 0x93cb99c 2024-09-18T00:32:17.702 INFO:teuthology.orchestra.run.smithi081.stdout:2017 write 0x9620183 thru 0x96258e3 (0x5761 bytes) 2024-09-18T00:32:17.704 INFO:teuthology.orchestra.run.smithi081.stdout:2021 writesame 0x28c8934 thru 0x28d11fc data_size 0x13(0x88c9 bytes) 2024-09-18T00:32:17.707 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.707 INFO:teuthology.orchestra.run.smithi081.stdout:2023 read 0x6901035 thru 0x6903358 (0x2324 bytes) 2024-09-18T00:32:17.707 INFO:teuthology.orchestra.run.smithi081.stdout:2025 punch from 0x18fae1f to 0x1903b2c, (0x8d0d bytes) 2024-09-18T00:32:17.707 INFO:teuthology.orchestra.run.smithi081.stdout:2027 read 0x6e25ec1 thru 0x6e2a875 (0x49b5 bytes) 2024-09-18T00:32:17.707 INFO:teuthology.orchestra.run.smithi081.stdout:2028 read 0x55ef16 thru 0x562437 (0x3522 bytes) 2024-09-18T00:32:17.708 INFO:teuthology.orchestra.run.smithi081.stdout:2029 read 0x4b9e7db thru 0x4bad5d1 (0xedf7 bytes) 2024-09-18T00:32:17.708 INFO:teuthology.orchestra.run.smithi081.stdout:2030 read 0x7f6ce32 thru 0x7f7cd4a (0xff19 bytes) 2024-09-18T00:32:17.708 INFO:teuthology.orchestra.run.smithi081.stdout:2031 read 0x2dfcf7b thru 0x2e0b6da (0xe760 bytes) 2024-09-18T00:32:17.709 INFO:teuthology.orchestra.run.smithi081.stdout:2032 read 0x4a8425e thru 0x4a92305 (0xe0a8 bytes) 2024-09-18T00:32:17.709 INFO:teuthology.orchestra.run.smithi081.stdout:2033 read 0x46c4fb5 thru 0x46d2624 (0xd670 bytes) 2024-09-18T00:32:17.709 INFO:teuthology.orchestra.run.smithi081.stdout:2035 write 0x21bc9da thru 0x21ca6ac (0xdcd3 bytes) 2024-09-18T00:32:17.710 INFO:teuthology.orchestra.run.smithi081.stdout:2036 writesame 0x21594fb thru 0x2162c68 data_size 0x5b(0x976e bytes) 2024-09-18T00:32:17.713 INFO:teuthology.orchestra.run.smithi081.stdout:2037 trunc from 0x96258e4 to 0x9f4bef7 2024-09-18T00:32:17.718 INFO:teuthology.orchestra.run.smithi081.stdout:2038 punch from 0x9cee5e1 to 0x9cfaaaf, (0xc4ce bytes) 2024-09-18T00:32:17.718 INFO:teuthology.orchestra.run.smithi081.stdout:2040 read 0x3f38616 thru 0x3f3c399 (0x3d84 bytes) 2024-09-18T00:32:17.718 INFO:teuthology.orchestra.run.smithi081.stdout:2041 punch from 0x62bf1c0 to 0x62c3ea0, (0x4ce0 bytes) 2024-09-18T00:32:17.719 INFO:teuthology.orchestra.run.smithi081.stdout:2042 read 0x96e3971 thru 0x96ee9c8 (0xb058 bytes) 2024-09-18T00:32:17.719 INFO:teuthology.orchestra.run.smithi081.stdout:2043 read 0x246c27c thru 0x2478c53 (0xc9d8 bytes) 2024-09-18T00:32:17.719 INFO:teuthology.orchestra.run.smithi081.stdout:2044 trunc from 0x9f4bef7 to 0xa1f4b1a 2024-09-18T00:32:17.723 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.724 INFO:teuthology.orchestra.run.smithi081.stdout:2047 trunc from 0xa1f4b1a to 0xb17fa2c 2024-09-18T00:32:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:2048 write 0x22bec70 thru 0x22ca925 (0xbcb6 bytes) 2024-09-18T00:32:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:2050 write 0x5c27d33 thru 0x5c3669b (0xe969 bytes) 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:2053 read 0x52b4cda thru 0x52c2e60 (0xe187 bytes) 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:2054 punch from 0xcbadb5 to 0xcc129e, (0x64e9 bytes) 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:2057 punch from 0xa97b06d to 0xa97c7e2, (0x1775 bytes) 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:2059 punch from 0x458f252 to 0x45939e5, (0x4793 bytes) 2024-09-18T00:32:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:2061 trunc from 0xb17fa2c to 0xb22e066 2024-09-18T00:32:17.744 INFO:teuthology.orchestra.run.smithi081.stdout:2064 write 0x2618a46 thru 0x2624693 (0xbc4e bytes) 2024-09-18T00:32:17.751 INFO:teuthology.orchestra.run.smithi081.stdout:2065 trunc from 0xb22e066 to 0x6401e03 2024-09-18T00:32:17.762 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:17.760+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:17.778 INFO:teuthology.orchestra.run.smithi081.stdout:2068 writesame 0xea0d0a4 thru 0xea1104d data_size 0x1(0x3faa bytes) 2024-09-18T00:32:17.778 INFO:teuthology.orchestra.run.smithi081.stdout:2069 punch from 0x1ca77b4 to 0x1cb04fa, (0x8d46 bytes) 2024-09-18T00:32:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:17.778 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:17.778 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:17.779 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:17.785 INFO:teuthology.orchestra.run.smithi081.stdout:2070 trunc from 0xea1104e to 0x8a7dfc8 2024-09-18T00:32:17.787 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:17.799 INFO:teuthology.orchestra.run.smithi081.stdout:2073 write 0xa28fe28 thru 0xa29d6e4 (0xd8bd bytes) 2024-09-18T00:32:17.803 INFO:teuthology.orchestra.run.smithi081.stdout:2074 read 0x8ce8f1e thru 0x8cf8c84 (0xfd67 bytes) 2024-09-18T00:32:17.803 INFO:teuthology.orchestra.run.smithi081.stdout:2075 read 0xf4e3a5 thru 0xf54da1 (0x69fd bytes) 2024-09-18T00:32:17.804 INFO:teuthology.orchestra.run.smithi081.stdout:2077 write 0x7623a7f thru 0x7631010 (0xd592 bytes) 2024-09-18T00:32:17.810 INFO:teuthology.orchestra.run.smithi081.stdout:2078 punch from 0x6db1b81 to 0x6dbed96, (0xd215 bytes) 2024-09-18T00:32:17.816 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:17.818 INFO:teuthology.orchestra.run.smithi081.stdout:2080 trunc from 0xa29d6e5 to 0x387b40c 2024-09-18T00:32:17.837 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:17.837 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:17.839 INFO:teuthology.orchestra.run.smithi081.stdout:2082 trunc from 0x387b40c to 0x477b80d 2024-09-18T00:32:17.855 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:17.856 INFO:teuthology.orchestra.run.smithi081.stdout:2083 write 0x93d304e thru 0x93dcd5d (0x9d10 bytes) 2024-09-18T00:32:17.859 INFO:teuthology.orchestra.run.smithi081.stdout:2084 write 0x18e257c thru 0x18f119c (0xec21 bytes) 2024-09-18T00:32:17.863 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:17.861+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:17.866 INFO:teuthology.orchestra.run.smithi081.stdout:2085 read 0x5b664f9 thru 0x5b6f40a (0x8f12 bytes) 2024-09-18T00:32:17.866 INFO:teuthology.orchestra.run.smithi081.stdout:2086 write 0x5f51da5 thru 0x5f59578 (0x77d4 bytes) 2024-09-18T00:32:17.869 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.869 INFO:teuthology.orchestra.run.smithi081.stdout:2089 read 0x2b7bd65 thru 0x2b7f0c7 (0x3363 bytes) 2024-09-18T00:32:17.874 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:17.880 INFO:teuthology.orchestra.run.smithi081.stdout:2091 writesame 0xd9b176b thru 0xd9c0a25 data_size 0x4d(0xf2bb bytes) 2024-09-18T00:32:17.880 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:17.881 INFO:teuthology.orchestra.run.smithi081.stdout:2093 read 0xab216e4 thru 0xab3097e (0xf29b bytes) 2024-09-18T00:32:17.881 INFO:teuthology.orchestra.run.smithi081.stdout:2094 punch from 0xbe7036e to 0xbe7443b, (0x40cd bytes) 2024-09-18T00:32:17.881 INFO:teuthology.orchestra.run.smithi081.stdout:2096 write 0xd20059c thru 0xd209efb (0x9960 bytes) 2024-09-18T00:32:17.883 INFO:teuthology.orchestra.run.smithi081.stdout:2097 clone 19 order 22 su 131072 sc 12 2024-09-18T00:32:17.891 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:17.908 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:17.925 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:17.934 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:17.934 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:17.941 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:17.943 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:17.987 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:17.986+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:18.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:32:18.052 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.052 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.058 INFO:teuthology.orchestra.run.smithi081.stdout:flattening image image_client.0-clone18 2024-09-18T00:32:18.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:18.105 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:18.103+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:18.167 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:18.165+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:18.207 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.207 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:18.238 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-18T00:32:18.239 INFO:teuthology.orchestra.run.smithi081.stdout:2098 punch from 0x64b9666 to 0x64c0ae1, (0x747b bytes) 2024-09-18T00:32:18.243 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.248 INFO:teuthology.orchestra.run.smithi081.stdout:2100 trunc from 0xd9c0a26 to 0x985f57e 2024-09-18T00:32:18.267 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:18.265+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:18.271 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.271 INFO:teuthology.orchestra.run.smithi081.stdout:2102 write 0x48b972b thru 0x48c720a (0xdae0 bytes) 2024-09-18T00:32:18.285 INFO:teuthology.orchestra.run.smithi081.stdout:2103 trunc from 0x985f57e to 0x44e9025 2024-09-18T00:32:18.316 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.316 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.316 INFO:teuthology.orchestra.run.smithi081.stdout:2110 write 0x230c6d2 thru 0x231c576 (0xfea5 bytes) 2024-09-18T00:32:18.328 INFO:teuthology.orchestra.run.smithi081.stdout:2111 trunc from 0x44e9025 to 0x95b1216 2024-09-18T00:32:18.334 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.334 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.334 INFO:teuthology.orchestra.run.smithi081.stdout:2116 punch from 0x32834d5 to 0x3287c59, (0x4784 bytes) 2024-09-18T00:32:18.335 INFO:teuthology.orchestra.run.smithi081.stdout:2117 punch from 0x4659911 to 0x4660208, (0x68f7 bytes) 2024-09-18T00:32:18.335 INFO:teuthology.orchestra.run.smithi081.stdout:2119 write 0x2a7d81f thru 0x2a8a8af (0xd091 bytes) 2024-09-18T00:32:18.340 INFO:teuthology.orchestra.run.smithi081.stdout:2121 read 0x535fdc7 thru 0x536948b (0x96c5 bytes) 2024-09-18T00:32:18.341 INFO:teuthology.orchestra.run.smithi081.stdout:2122 punch from 0xe1e1c0 to 0xe2a0c2, (0xbf02 bytes) 2024-09-18T00:32:18.341 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.343 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:18.351 INFO:teuthology.orchestra.run.smithi081.stdout:2124 write 0xcde3676 thru 0xcde9726 (0x60b1 bytes) 2024-09-18T00:32:18.354 INFO:teuthology.orchestra.run.smithi081.stdout:2125 read 0x31f6de5 thru 0x31fd049 (0x6265 bytes) 2024-09-18T00:32:18.355 INFO:teuthology.orchestra.run.smithi081.stdout:2126 read 0xa2566a3 thru 0xa258e16 (0x2774 bytes) 2024-09-18T00:32:18.355 INFO:teuthology.orchestra.run.smithi081.stdout:2127 punch from 0x6493303 to 0x649e93e, (0xb63b bytes) 2024-09-18T00:32:18.355 INFO:teuthology.orchestra.run.smithi081.stdout:2129 writesame 0x8470430 thru 0x847f95f data_size 0x8(0xf530 bytes) 2024-09-18T00:32:18.361 INFO:teuthology.orchestra.run.smithi081.stdout:2130 read 0x4c15158 thru 0x4c20c1d (0xbac6 bytes) 2024-09-18T00:32:18.362 INFO:teuthology.orchestra.run.smithi081.stdout:2133 read 0x2c831bd thru 0x2c8ab94 (0x79d8 bytes) 2024-09-18T00:32:18.363 INFO:teuthology.orchestra.run.smithi081.stdout:2134 writesame 0x6d9cae9 thru 0x6da9bee data_size 0x5(0xd106 bytes) 2024-09-18T00:32:18.370 INFO:teuthology.orchestra.run.smithi081.stdout:2135 read 0x5ac02de thru 0x5ac9c3d (0x9960 bytes) 2024-09-18T00:32:18.371 INFO:teuthology.orchestra.run.smithi081.stdout:2136 write 0xb13c364 thru 0xb1425af (0x624c bytes) 2024-09-18T00:32:18.374 INFO:teuthology.orchestra.run.smithi081.stdout:2137 write 0x78dca5f thru 0x78e7188 (0xa72a bytes) 2024-09-18T00:32:18.378 INFO:teuthology.orchestra.run.smithi081.stdout:2139 write 0x5f8dbb3 thru 0x5f95d89 (0x81d7 bytes) 2024-09-18T00:32:18.379 INFO:teuthology.orchestra.run.smithi081.stdout:2140 read 0x6ac95de thru 0x6ad5724 (0xc147 bytes) 2024-09-18T00:32:18.385 INFO:teuthology.orchestra.run.smithi081.stdout:2141 trunc from 0xcde9727 to 0x8a1a051 2024-09-18T00:32:18.387 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:18.386+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:18.396 INFO:teuthology.orchestra.run.smithi081.stdout:2145 write 0x2c2035a thru 0x2c2f6df (0xf386 bytes) 2024-09-18T00:32:18.407 INFO:teuthology.orchestra.run.smithi081.stdout:2146 trunc from 0x8a1a051 to 0x4fda2c1 2024-09-18T00:32:18.420 INFO:teuthology.orchestra.run.smithi081.stdout:2148 read 0x37a38e2 thru 0x37b0411 (0xcb30 bytes) 2024-09-18T00:32:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:2149 write 0xaf07318 thru 0xaf0f552 (0x823b bytes) 2024-09-18T00:32:18.436 INFO:teuthology.orchestra.run.smithi081.stdout:2150 read 0x24eb83d thru 0x24f2aba (0x727e bytes) 2024-09-18T00:32:18.437 INFO:teuthology.orchestra.run.smithi081.stdout:2151 read 0x27defe9 thru 0x27ec0a3 (0xd0bb bytes) 2024-09-18T00:32:18.438 INFO:teuthology.orchestra.run.smithi081.stdout:2152 trunc from 0xaf0f553 to 0xbcb4011 2024-09-18T00:32:18.444 INFO:teuthology.orchestra.run.smithi081.stdout:2153 writesame 0x24dbd53 thru 0x24e6914 data_size 0x5(0xabc2 bytes) 2024-09-18T00:32:18.457 INFO:teuthology.orchestra.run.smithi081.stdout:2155 write 0xb99a46c thru 0xb9a2d0b (0x88a0 bytes) 2024-09-18T00:32:18.460 INFO:teuthology.orchestra.run.smithi081.stdout:2156 read 0xa9206e thru 0xa9f6a3 (0xd636 bytes) 2024-09-18T00:32:18.461 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.461 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.461 INFO:teuthology.orchestra.run.smithi081.stdout:2157 read 0xaa44324 thru 0xaa524da (0xe1b7 bytes) 2024-09-18T00:32:18.467 INFO:teuthology.orchestra.run.smithi081.stdout:2158 trunc from 0xbcb4011 to 0x6d178f9 2024-09-18T00:32:18.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:18.470 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:18.468+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:18.486 INFO:teuthology.orchestra.run.smithi081.stdout:2159 write 0x9753caa thru 0x9755563 (0x18ba bytes) 2024-09-18T00:32:18.489 INFO:teuthology.orchestra.run.smithi081.stdout:2161 read 0x3305d2e thru 0x330898e (0x2c61 bytes) 2024-09-18T00:32:18.495 INFO:teuthology.orchestra.run.smithi081.stdout:2162 trunc from 0x9755564 to 0x5039d20 2024-09-18T00:32:18.507 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.510 INFO:teuthology.orchestra.run.smithi081.stdout:2164 trunc from 0x5039d20 to 0x23da47e 2024-09-18T00:32:18.562 INFO:teuthology.orchestra.run.smithi081.stdout:2165 writesame 0xb8db64d thru 0xb8e7db1 data_size 0x7b(0xc765 bytes) 2024-09-18T00:32:18.566 INFO:teuthology.orchestra.run.smithi081.stdout:2167 trunc from 0xb8e7db2 to 0x79e43b3 2024-09-18T00:32:18.570 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:18.569+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:18.572 INFO:teuthology.orchestra.run.smithi081.stdout:2169 read 0xeb77a8 thru 0xebabe6 (0x343f bytes) 2024-09-18T00:32:18.580 INFO:teuthology.orchestra.run.smithi081.stdout:2171 write 0x8e900ac thru 0x8e9a351 (0xa2a6 bytes) 2024-09-18T00:32:18.596 INFO:teuthology.orchestra.run.smithi081.stdout:2172 write 0xec5cf71 thru 0xec5f95b (0x29eb bytes) 2024-09-18T00:32:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:2173 punch from 0x79f3d2f to 0x79fc2f4, (0x85c5 bytes) 2024-09-18T00:32:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:2174 write 0x347876d thru 0x3486a18 (0xe2ac bytes) 2024-09-18T00:32:18.603 INFO:teuthology.orchestra.run.smithi081.stdout:2175 writesame 0x5b24e90 thru 0x5b2b3de data_size 0x27(0x654f bytes) 2024-09-18T00:32:18.612 INFO:teuthology.orchestra.run.smithi081.stdout:2176 write 0xed3108e thru 0xed3a89a (0x980d bytes) 2024-09-18T00:32:18.625 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.625 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.626 INFO:teuthology.orchestra.run.smithi081.stdout:2177 trunc from 0xed3a89b to 0x61fdd49 2024-09-18T00:32:18.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:18.636 INFO:teuthology.orchestra.run.smithi081.stdout:2178 punch from 0x1fd3b83 to 0x1fda1b4, (0x6631 bytes) 2024-09-18T00:32:18.637 INFO:teuthology.orchestra.run.smithi081.stdout:2179 punch from 0x257f13d to 0x258784e, (0x8711 bytes) 2024-09-18T00:32:18.637 INFO:teuthology.orchestra.run.smithi081.stdout:2180 writesame 0x21f0cb4 thru 0x22002ba data_size 0x1(0xf607 bytes) 2024-09-18T00:32:18.673 INFO:teuthology.orchestra.run.smithi081.stdout:2181 punch from 0x67e75f to 0x689e95, (0xb736 bytes) 2024-09-18T00:32:18.673 INFO:teuthology.orchestra.run.smithi081.stdout:2183 read 0x55040ea thru 0x551173b (0xd652 bytes) 2024-09-18T00:32:18.673 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.673 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.673 INFO:teuthology.orchestra.run.smithi081.stdout:2191 writesame 0x39468f0 thru 0x395617d data_size 0x46(0xf88e bytes) 2024-09-18T00:32:18.679 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:18.678+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:18.681 INFO:teuthology.orchestra.run.smithi081.stdout:2192 write 0x3e15a8d thru 0x3e23113 (0xd687 bytes) 2024-09-18T00:32:18.700 INFO:teuthology.orchestra.run.smithi081.stdout:2193 writesame 0xe04f722 thru 0xe052737 data_size 0x5(0x3016 bytes) 2024-09-18T00:32:18.700 INFO:teuthology.orchestra.run.smithi081.stdout:2195 write 0x3ca7d98 thru 0x3cad2c5 (0x552e bytes) 2024-09-18T00:32:18.709 INFO:teuthology.orchestra.run.smithi081.stdout:2196 write 0xeb8f10b thru 0xeb9ea92 (0xf988 bytes) 2024-09-18T00:32:18.712 INFO:teuthology.orchestra.run.smithi081.stdout:2197 write 0x1ef0c57 thru 0x1ef3ffa (0x33a4 bytes) 2024-09-18T00:32:18.713 INFO:teuthology.orchestra.run.smithi081.stdout:2198 write 0xafcdc8 thru 0xb03703 (0x693c bytes) 2024-09-18T00:32:18.715 INFO:teuthology.orchestra.run.smithi081.stdout:2199 writesame 0x5a94ae5 thru 0x5aa2947 data_size 0x7(0xde63 bytes) 2024-09-18T00:32:18.733 INFO:teuthology.orchestra.run.smithi081.stdout:2200 trunc from 0xeb9ea93 to 0x4473539 2024-09-18T00:32:18.743 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.743 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:18.759 INFO:teuthology.orchestra.run.smithi081.stdout:2202 write 0x94a1261 thru 0x94a375d (0x24fd bytes) 2024-09-18T00:32:18.764 INFO:teuthology.orchestra.run.smithi081.stdout:2203 trunc from 0x94a375e to 0xb366ca7 2024-09-18T00:32:18.769 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.769 INFO:teuthology.orchestra.run.smithi081.stdout:2205 read 0x4504b2e thru 0x450e838 (0x9d0b bytes) 2024-09-18T00:32:18.769 INFO:teuthology.orchestra.run.smithi081.stdout:2206 write 0x7c9be2e thru 0x7ca2fbb (0x718e bytes) 2024-09-18T00:32:18.787 INFO:teuthology.orchestra.run.smithi081.stdout:2207 trunc from 0xb366ca7 to 0x19d3319 2024-09-18T00:32:18.794 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:18.792+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:18.817 INFO:teuthology.orchestra.run.smithi081.stdout:2208 write 0xa030e8c thru 0xa031f3b (0x10b0 bytes) 2024-09-18T00:32:18.823 INFO:teuthology.orchestra.run.smithi081.stdout:2209 trunc from 0xa031f3c to 0x773fec5 2024-09-18T00:32:18.839 INFO:teuthology.orchestra.run.smithi081.stdout:2211 trunc from 0x773fec5 to 0xbd387c5 2024-09-18T00:32:18.844 INFO:teuthology.orchestra.run.smithi081.stdout:2212 write 0x7e4b65a thru 0x7e50b4f (0x54f6 bytes) 2024-09-18T00:32:18.847 INFO:teuthology.orchestra.run.smithi081.stdout:2213 writesame 0x8c1c669 thru 0x8c235ed data_size 0x1(0x6f85 bytes) 2024-09-18T00:32:18.864 INFO:teuthology.orchestra.run.smithi081.stdout:2215 write 0x67c27a7 thru 0x67c6c48 (0x44a2 bytes) 2024-09-18T00:32:18.866 INFO:teuthology.orchestra.run.smithi081.stdout:2218 read 0x34960dd thru 0x349732f (0x1253 bytes) 2024-09-18T00:32:18.866 INFO:teuthology.orchestra.run.smithi081.stdout:2219 punch from 0xa0f07aa to 0xa0fd368, (0xcbbe bytes) 2024-09-18T00:32:18.866 INFO:teuthology.orchestra.run.smithi081.stdout:2220 writesame 0x7038e27 thru 0x703e31e data_size 0x1(0x54f8 bytes) 2024-09-18T00:32:18.869 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.869 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.874 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:18.872+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:18.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:18.879 INFO:teuthology.orchestra.run.smithi081.stdout:2221 punch from 0x8490d09 to 0x8496fe5, (0x62dc bytes) 2024-09-18T00:32:18.879 INFO:teuthology.orchestra.run.smithi081.stdout:2225 read 0xa7a3997 thru 0xa7adc7f (0xa2e9 bytes) 2024-09-18T00:32:18.879 INFO:teuthology.orchestra.run.smithi081.stdout:2226 read 0x9dab4aa thru 0x9daebb6 (0x370d bytes) 2024-09-18T00:32:18.880 INFO:teuthology.orchestra.run.smithi081.stdout:2227 write 0xa567e8f thru 0xa573a2f (0xbba1 bytes) 2024-09-18T00:32:18.882 INFO:teuthology.orchestra.run.smithi081.stdout:2228 read 0x13cc21 thru 0x142ddc (0x61bc bytes) 2024-09-18T00:32:18.885 INFO:teuthology.orchestra.run.smithi081.stdout:2229 trunc from 0xbd387c5 to 0xd66173e 2024-09-18T00:32:18.891 INFO:teuthology.orchestra.run.smithi081.stdout:2230 read 0xae000eb thru 0xae05d26 (0x5c3c bytes) 2024-09-18T00:32:18.891 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.892 INFO:teuthology.orchestra.run.smithi081.stdout:2237 write 0xcd44335 thru 0xcd447cc (0x498 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2238 read 0xb7bdfb5 thru 0xb7cd939 (0xf985 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2239 read 0xc9ad1c1 thru 0xc9b6319 (0x9159 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2244 punch from 0x1e65575 to 0x1e6f227, (0x9cb2 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2246 read 0x35ff110 thru 0x35ff2b7 (0x1a8 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2247 punch from 0x7a19495 to 0x7a27f5f, (0xeaca bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2250 punch from 0x6beb66a to 0x6bf80cd, (0xca63 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2251 read 0xac4850a thru 0xac53e0a (0xb901 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:2252 punch from 0x1564b08 to 0x1565da9, (0x12a1 bytes) 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.895 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.896 INFO:teuthology.orchestra.run.smithi081.stdout:2256 read 0x2a9e7be thru 0x2a9fe2b (0x166e bytes) 2024-09-18T00:32:18.896 INFO:teuthology.orchestra.run.smithi081.stdout:2257 writesame 0x1267796 thru 0x126ee81 data_size 0x56(0x76ec bytes) 2024-09-18T00:32:18.897 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.897 INFO:teuthology.orchestra.run.smithi081.stdout:2260 read 0x4a29ff4 thru 0x4a34086 (0xa093 bytes) 2024-09-18T00:32:18.897 INFO:teuthology.orchestra.run.smithi081.stdout:2261 read 0x82873c7 thru 0x828f05e (0x7c98 bytes) 2024-09-18T00:32:18.897 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.897 INFO:teuthology.orchestra.run.smithi081.stdout:2263 write 0x4699e74 thru 0x469da31 (0x3bbe bytes) 2024-09-18T00:32:18.900 INFO:teuthology.orchestra.run.smithi081.stdout:2265 read 0xaf755ba thru 0xaf824e4 (0xcf2b bytes) 2024-09-18T00:32:18.900 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.900 INFO:teuthology.orchestra.run.smithi081.stdout:2267 punch from 0xa5a22b8 to 0xa5b06d2, (0xe41a bytes) 2024-09-18T00:32:18.907 INFO:teuthology.orchestra.run.smithi081.stdout:2268 write 0xebae388 thru 0xebb2a54 (0x46cd bytes) 2024-09-18T00:32:18.910 INFO:teuthology.orchestra.run.smithi081.stdout:2270 read 0x2bcb030 thru 0x2bcb84f (0x820 bytes) 2024-09-18T00:32:18.910 INFO:teuthology.orchestra.run.smithi081.stdout:2271 write 0xd699d6f thru 0xd6a20a4 (0x8336 bytes) 2024-09-18T00:32:18.913 INFO:teuthology.orchestra.run.smithi081.stdout:2272 write 0x692adea thru 0x6936d45 (0xbf5c bytes) 2024-09-18T00:32:18.916 INFO:teuthology.orchestra.run.smithi081.stdout:2273 read 0x5df278b thru 0x5dfca5b (0xa2d1 bytes) 2024-09-18T00:32:18.916 INFO:teuthology.orchestra.run.smithi081.stdout:2274 writesame 0x8b4fe69 thru 0x8b57a15 data_size 0x1(0x7bad bytes) 2024-09-18T00:32:18.933 INFO:teuthology.orchestra.run.smithi081.stdout:2275 writesame 0x6e6a1d0 thru 0x6e70814 data_size 0x3(0x6645 bytes) 2024-09-18T00:32:18.942 INFO:teuthology.orchestra.run.smithi081.stdout:2279 write 0x6f31f80 thru 0x6f372fb (0x537c bytes) 2024-09-18T00:32:18.943 INFO:teuthology.orchestra.run.smithi081.stdout:2280 write 0x548ca99 thru 0x549708e (0xa5f6 bytes) 2024-09-18T00:32:18.960 INFO:teuthology.orchestra.run.smithi081.stdout:2282 trunc from 0xebb2a55 to 0x3834096 2024-09-18T00:32:18.975 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:18.973+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:18.981 INFO:teuthology.orchestra.run.smithi081.stdout:2283 write 0x42167ba thru 0x4224902 (0xe149 bytes) 2024-09-18T00:32:18.991 INFO:teuthology.orchestra.run.smithi081.stdout:2284 writesame 0x573e26b thru 0x5743f1c data_size 0x69(0x5cb2 bytes) 2024-09-18T00:32:18.992 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:18.992 INFO:teuthology.orchestra.run.smithi081.stdout:2288 punch from 0x258af86 to 0x258fae9, (0x4b63 bytes) 2024-09-18T00:32:18.992 INFO:teuthology.orchestra.run.smithi081.stdout:2289 writesame 0x2bc5b6f thru 0x2bcc93b data_size 0x1(0x6dcd bytes) 2024-09-18T00:32:18.997 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:18.997 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:32:19.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:19.011 INFO:teuthology.orchestra.run.smithi081.stdout:2290 write 0x189c55c thru 0x189dfcf (0x1a74 bytes) 2024-09-18T00:32:19.029 INFO:teuthology.orchestra.run.smithi081.stdout:2295 write 0xacfa5a7 thru 0xacfed43 (0x479d bytes) 2024-09-18T00:32:19.032 INFO:teuthology.orchestra.run.smithi081.stdout:2296 read 0x5bc60b9 thru 0x5bcc9d1 (0x6919 bytes) 2024-09-18T00:32:19.032 INFO:teuthology.orchestra.run.smithi081.stdout:2298 punch from 0x7f67eea to 0x7f7263f, (0xa755 bytes) 2024-09-18T00:32:19.032 INFO:teuthology.orchestra.run.smithi081.stdout:2299 punch from 0x5954a93 to 0x5955297, (0x804 bytes) 2024-09-18T00:32:19.041 INFO:teuthology.orchestra.run.smithi081.stdout:2300 trunc from 0xacfed44 to 0x3018b8b 2024-09-18T00:32:19.075 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:19.074+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:19.076 INFO:teuthology.orchestra.run.smithi081.stdout:2302 write 0xe451213 thru 0xe461121 (0xff0f bytes) 2024-09-18T00:32:19.081 INFO:teuthology.orchestra.run.smithi081.stdout:2304 read 0x8e5531c thru 0x8e57094 (0x1d79 bytes) 2024-09-18T00:32:19.081 INFO:teuthology.orchestra.run.smithi081.stdout:2306 writesame 0x5c131b5 thru 0x5c22779 data_size 0x1(0xf5c5 bytes) 2024-09-18T00:32:19.121 INFO:teuthology.orchestra.run.smithi081.stdout:2308 write 0x5252021 thru 0x525cb12 (0xaaf2 bytes) 2024-09-18T00:32:19.129 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.129 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.131 INFO:teuthology.orchestra.run.smithi081.stdout:2309 trunc from 0xe461122 to 0x919311e 2024-09-18T00:32:19.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:19.145 INFO:teuthology.orchestra.run.smithi081.stdout:2311 punch from 0x76fffc6 to 0x7705200, (0x523a bytes) 2024-09-18T00:32:19.145 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.145 INFO:teuthology.orchestra.run.smithi081.stdout:2314 read 0x7dfcbac thru 0x7dfdec0 (0x1315 bytes) 2024-09-18T00:32:19.145 INFO:teuthology.orchestra.run.smithi081.stdout:2315 write 0x1c2754c thru 0x1c2acac (0x3761 bytes) 2024-09-18T00:32:19.150 INFO:teuthology.orchestra.run.smithi081.stdout:2316 trunc from 0x919311e to 0xc1138c2 2024-09-18T00:32:19.156 INFO:teuthology.orchestra.run.smithi081.stdout:2317 write 0x4003631 thru 0x40100e5 (0xcab5 bytes) 2024-09-18T00:32:19.159 INFO:teuthology.orchestra.run.smithi081.stdout:2318 punch from 0x3001d3e to 0x30091ce, (0x7490 bytes) 2024-09-18T00:32:19.159 INFO:teuthology.orchestra.run.smithi081.stdout:2319 punch from 0x8cc52fc to 0x8cce5e2, (0x92e6 bytes) 2024-09-18T00:32:19.159 INFO:teuthology.orchestra.run.smithi081.stdout:2321 read 0xb43b267 thru 0xb43bcb9 (0xa53 bytes) 2024-09-18T00:32:19.159 INFO:teuthology.orchestra.run.smithi081.stdout:2323 write 0x2ad2be thru 0x2b1520 (0x4263 bytes) 2024-09-18T00:32:19.169 INFO:teuthology.orchestra.run.smithi081.stdout:2324 write 0xed59bef thru 0xed69777 (0xfb89 bytes) 2024-09-18T00:32:19.176 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:19.175+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:19.186 INFO:teuthology.orchestra.run.smithi081.stdout:2327 trunc from 0xed69778 to 0x3928014 2024-09-18T00:32:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:2329 write 0x5c8abb thru 0x5c9c84 (0x11ca bytes) 2024-09-18T00:32:19.205 INFO:teuthology.orchestra.run.smithi081.stdout:2330 writesame 0x4718b3d thru 0x471dc4a data_size 0xa(0x510e bytes) 2024-09-18T00:32:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:2333 punch from 0x26fdad1 to 0x2704af4, (0x7023 bytes) 2024-09-18T00:32:19.223 INFO:teuthology.orchestra.run.smithi081.stdout:2334 write 0xdac4212 thru 0xdac93d5 (0x51c4 bytes) 2024-09-18T00:32:19.226 INFO:teuthology.orchestra.run.smithi081.stdout:2335 read 0x13513fd thru 0x1354e86 (0x3a8a bytes) 2024-09-18T00:32:19.226 INFO:teuthology.orchestra.run.smithi081.stdout:2336 write 0x2ea10b3 thru 0x2ea623f (0x518d bytes) 2024-09-18T00:32:19.228 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.228 INFO:teuthology.orchestra.run.smithi081.stdout:2338 writesame 0x7ee66e1 thru 0x7eeafa8 data_size 0x44(0x48c8 bytes) 2024-09-18T00:32:19.247 INFO:teuthology.orchestra.run.smithi081.stdout:2339 trunc from 0xdac93d6 to 0xa8e3c 2024-09-18T00:32:19.265 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.265 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.269 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.269 INFO:teuthology.orchestra.run.smithi081.stdout:2342 read 0xa5777 thru 0xa8e3b (0x36c5 bytes) 2024-09-18T00:32:19.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:19.286 INFO:teuthology.orchestra.run.smithi081.stdout:2343 write 0x85f0aa4 thru 0x85f6b68 (0x60c5 bytes) 2024-09-18T00:32:19.286 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:19.284+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:19.289 INFO:teuthology.orchestra.run.smithi081.stdout:2344 trunc from 0x85f6b69 to 0x77372dd 2024-09-18T00:32:19.296 INFO:teuthology.orchestra.run.smithi081.stdout:2345 read 0x1769b98 thru 0x176bd1c (0x2185 bytes) 2024-09-18T00:32:19.296 INFO:teuthology.orchestra.run.smithi081.stdout:2346 read 0x63d4ac4 thru 0x63da8e0 (0x5e1d bytes) 2024-09-18T00:32:19.300 INFO:teuthology.orchestra.run.smithi081.stdout:2349 trunc from 0x77372dd to 0x4144f26 2024-09-18T00:32:19.309 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.309 INFO:teuthology.orchestra.run.smithi081.stdout:2352 punch from 0x2536055 to 0x253b175, (0x5120 bytes) 2024-09-18T00:32:19.310 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.310 INFO:teuthology.orchestra.run.smithi081.stdout:2354 trunc from 0x4144f26 to 0x4bddb7b 2024-09-18T00:32:19.315 INFO:teuthology.orchestra.run.smithi081.stdout:2355 read 0xd03973 thru 0xd07c92 (0x4320 bytes) 2024-09-18T00:32:19.323 INFO:teuthology.orchestra.run.smithi081.stdout:2357 trunc from 0x4bddb7b to 0xb574597 2024-09-18T00:32:19.343 INFO:teuthology.orchestra.run.smithi081.stdout:2358 trunc from 0xb574597 to 0x76ed0 2024-09-18T00:32:19.360 INFO:teuthology.orchestra.run.smithi081.stdout:2359 read 0x1955 thru 0x4fc7 (0x3673 bytes) 2024-09-18T00:32:19.375 INFO:teuthology.orchestra.run.smithi081.stdout:2360 write 0x93bfc9c thru 0x93c7af7 (0x7e5c bytes) 2024-09-18T00:32:19.377 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:19.376+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:19.378 INFO:teuthology.orchestra.run.smithi081.stdout:2362 read 0x841830c thru 0x8421716 (0x940b bytes) 2024-09-18T00:32:19.384 INFO:teuthology.orchestra.run.smithi081.stdout:2363 writesame 0x9405482 thru 0x940803a data_size 0x15(0x2bb9 bytes) 2024-09-18T00:32:19.386 INFO:teuthology.orchestra.run.smithi081.stdout:2364 trunc from 0x940803b to 0x79f5447 2024-09-18T00:32:19.396 INFO:teuthology.orchestra.run.smithi081.stdout:2365 trunc from 0x79f5447 to 0x792f998 2024-09-18T00:32:19.401 INFO:teuthology.orchestra.run.smithi081.stdout:2366 punch from 0x3be30f9 to 0x3be4f3c, (0x1e43 bytes) 2024-09-18T00:32:19.401 INFO:teuthology.orchestra.run.smithi081.stdout:2367 punch from 0x5991e34 to 0x599f8ed, (0xdab9 bytes) 2024-09-18T00:32:19.403 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.403 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.411 INFO:teuthology.orchestra.run.smithi081.stdout:2368 trunc from 0x792f998 to 0x4a6887 2024-09-18T00:32:19.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:19.440 INFO:teuthology.orchestra.run.smithi081.stdout:2369 write 0xda3f41d thru 0xda45497 (0x607b bytes) 2024-09-18T00:32:19.443 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.448 INFO:teuthology.orchestra.run.smithi081.stdout:2372 trunc from 0xda45498 to 0x99e4266 2024-09-18T00:32:19.466 INFO:teuthology.orchestra.run.smithi081.stdout:2374 writesame 0xca766d5 thru 0xca78103 data_size 0x1(0x1a2f bytes) 2024-09-18T00:32:19.466 INFO:teuthology.orchestra.run.smithi081.stdout:2375 read 0xc44487d thru 0xc4512ce (0xca52 bytes) 2024-09-18T00:32:19.467 INFO:teuthology.orchestra.run.smithi081.stdout:2376 write 0x9dd2c5a thru 0x9dd5f47 (0x32ee bytes) 2024-09-18T00:32:19.469 INFO:teuthology.orchestra.run.smithi081.stdout:2377 writesame 0x1be73bd thru 0x1bf218a data_size 0x1(0xadce bytes) 2024-09-18T00:32:19.478 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:19.477+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:19.497 INFO:teuthology.orchestra.run.smithi081.stdout:2378 read 0x2f72174 thru 0x2f75485 (0x3312 bytes) 2024-09-18T00:32:19.500 INFO:teuthology.orchestra.run.smithi081.stdout:2379 write 0x63b7a08 thru 0x63c26c7 (0xacc0 bytes) 2024-09-18T00:32:19.505 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:19.505 INFO:teuthology.orchestra.run.smithi081.stdout:2381 read 0xc47452c thru 0xc47669c (0x2171 bytes) 2024-09-18T00:32:19.509 INFO:teuthology.orchestra.run.smithi081.stdout:2383 trunc from 0xca78104 to 0x9c01be4 2024-09-18T00:32:19.517 INFO:teuthology.orchestra.run.smithi081.stdout:2385 write 0x9a1ec03 thru 0x9a2147c (0x287a bytes) 2024-09-18T00:32:19.534 INFO:teuthology.orchestra.run.smithi081.stdout:2386 writesame 0xcb0ba37 thru 0xcb1ae0c data_size 0x3b(0xf3d6 bytes) 2024-09-18T00:32:19.534 INFO:teuthology.orchestra.run.smithi081.stdout:2387 read 0x45c758c thru 0x45d20a7 (0xab1c bytes) 2024-09-18T00:32:19.534 INFO:teuthology.orchestra.run.smithi081.stdout:2388 read 0x45cbd96 thru 0x45d8079 (0xc2e4 bytes) 2024-09-18T00:32:19.534 INFO:teuthology.orchestra.run.smithi081.stdout:2389 read 0x9f0207b thru 0x9f12027 (0xffad bytes) 2024-09-18T00:32:19.534 INFO:teuthology.orchestra.run.smithi081.stdout:2390 read 0x35e16c9 thru 0x35e1f63 (0x89b bytes) 2024-09-18T00:32:19.542 INFO:teuthology.orchestra.run.smithi081.stdout:2391 writesame 0xed5ae48 thru 0xed6a5ab data_size 0x8e(0xf764 bytes) 2024-09-18T00:32:19.542 INFO:teuthology.orchestra.run.smithi081.stdout:2393 write 0xc6b6e8a thru 0xc6bc8ad (0x5a24 bytes) 2024-09-18T00:32:19.545 INFO:teuthology.orchestra.run.smithi081.stdout:2395 writesame 0x81ef22e thru 0x81f4b4e data_size 0x1(0x5921 bytes) 2024-09-18T00:32:19.560 INFO:teuthology.orchestra.run.smithi081.stdout:2397 writesame 0xe484467 thru 0xe48dd39 data_size 0x51(0x98d3 bytes) 2024-09-18T00:32:19.565 INFO:teuthology.orchestra.run.smithi081.stdout:2398 flatten 2024-09-18T00:32:19.568 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.568 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.570 INFO:teuthology.orchestra.run.smithi081.stdout:2400 read 0xb06e1ee thru 0xb07a915 (0xc728 bytes) 2024-09-18T00:32:19.571 INFO:teuthology.orchestra.run.smithi081.stdout:2401 write 0x646a68 thru 0x6514ec (0xaa85 bytes) 2024-09-18T00:32:19.573 INFO:teuthology.orchestra.run.smithi081.stdout:2402 read 0xa1be23b thru 0xa1c091f (0x26e5 bytes) 2024-09-18T00:32:19.573 INFO:teuthology.orchestra.run.smithi081.stdout:2403 read 0x25ed6ef thru 0x25f6de0 (0x96f2 bytes) 2024-09-18T00:32:19.573 INFO:teuthology.orchestra.run.smithi081.stdout:2404 write 0x1d78f49 thru 0x1d7e85d (0x5915 bytes) 2024-09-18T00:32:19.574 INFO:teuthology.orchestra.run.smithi081.stdout:2405 writesame 0xbd2dc9c thru 0xbd3a318 data_size 0x3d(0xc67d bytes) 2024-09-18T00:32:19.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:19.579 INFO:teuthology.orchestra.run.smithi081.stdout:2406 clone 20 order 18 su 2048 sc 5 2024-09-18T00:32:19.579 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:19.578+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:19.680 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:19.678+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:19.781 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:19.780+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:19.833 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.833 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:19.883 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:19.881+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:19.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:19.984 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:19.983+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:19.987 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:19.987 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:19.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:20.085 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:20.086 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:20.084+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:20.086 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:20.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:20.120 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:20.138 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:20.154 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:20.154 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:20.155 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:20.155 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:20.155 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:20.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:20.173 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:20.186 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:20.185+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:20.199 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:20.199 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:20.216 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:20.217 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-18T00:32:20.282 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:20.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:20.282 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:20.283 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:20.283 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:20.287 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:20.286+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:20.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:20.388 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:20.387+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:20.446 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:20.446 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:20.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.477060248000001, 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:20.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.476680591000001, 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:20.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:20.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:20.456 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.475851408, 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:20.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.469066805000001, 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:20.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:20.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.469046338999998, 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:20.465 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.469022249999998, 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.467176288000001, 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:20.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.467112469, 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:20.479 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:20.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:20.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.484 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.467083589000001, 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:20.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.467058612999999, 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:20.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:20.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.467039561, 2024-09-18T00:32:20.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:20.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:20.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.465090763999999, 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:20.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:20.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.465068306999999, 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.465039867000002, 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.509 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.465017559, 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.464997106999999, 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.464167658000001, 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.464126733000001, 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:20.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.464085485999998, 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:20.536 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:20.540 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.464062820999999, 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:20.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:20.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:20.546 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:2409 read 0xcea7a6a thru 0xceb4a10 (0xcfa7 bytes) 2024-09-18T00:32:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:2411 read 0xe5f9f72 thru 0xe5ffdf0 (0x5e7f bytes) 2024-09-18T00:32:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:2413 write 0xd49b720 thru 0xd49f220 (0x3b01 bytes) 2024-09-18T00:32:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:2415 write 0x37c7692 thru 0x37cc79a (0x5109 bytes) 2024-09-18T00:32:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:2417 write 0x714758b thru 0x71503af (0x8e25 bytes) 2024-09-18T00:32:20.548 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:20.544+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:20.560 INFO:teuthology.orchestra.run.smithi081.stdout:2419 read 0xb4fdb17 thru 0xb50481b (0x6d05 bytes) 2024-09-18T00:32:20.562 INFO:teuthology.orchestra.run.smithi081.stdout:2420 read 0x5a85877 thru 0x5a8faff (0xa289 bytes) 2024-09-18T00:32:20.562 INFO:teuthology.orchestra.run.smithi081.stdout:2423 punch from 0x4ac8fa8 to 0x4acf632, (0x668a bytes) 2024-09-18T00:32:20.562 INFO:teuthology.orchestra.run.smithi081.stdout:2425 read 0xec6e8c2 thru 0xec7d4c0 (0xebff bytes) 2024-09-18T00:32:20.562 INFO:teuthology.orchestra.run.smithi081.stdout:2426 read 0xaa994c7 thru 0xaa9d87c (0x43b6 bytes) 2024-09-18T00:32:20.563 INFO:teuthology.orchestra.run.smithi081.stdout:2427 read 0x12afb0a thru 0x12be095 (0xe58c bytes) 2024-09-18T00:32:20.563 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:20.563 INFO:teuthology.orchestra.run.smithi081.stdout:2429 write 0xc54f626 thru 0xc55d6ac (0xe087 bytes) 2024-09-18T00:32:20.582 INFO:teuthology.orchestra.run.smithi081.stdout:2431 read 0x7321f07 thru 0x732b568 (0x9662 bytes) 2024-09-18T00:32:20.582 INFO:teuthology.orchestra.run.smithi081.stdout:2432 write 0x499b0f0 thru 0x49a38bc (0x87cd bytes) 2024-09-18T00:32:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:2436 punch from 0x736adce to 0x7376ae5, (0xbd17 bytes) 2024-09-18T00:32:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:2437 read 0xdf00086 thru 0xdf000a2 (0x1d bytes) 2024-09-18T00:32:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:2438 write 0x9e0f2 thru 0xade2a (0xfd39 bytes) 2024-09-18T00:32:20.619 INFO:teuthology.orchestra.run.smithi081.stdout:2440 writesame 0x6020ec thru 0x609a69 data_size 0x1(0x797e bytes) 2024-09-18T00:32:20.643 INFO:teuthology.orchestra.run.smithi081.stdout:2441 read 0xcdb8dcc thru 0xcdbb11f (0x2354 bytes) 2024-09-18T00:32:20.643 INFO:teuthology.orchestra.run.smithi081.stdout:2442 read 0x4a2f3d1 thru 0x4a3d476 (0xe0a6 bytes) 2024-09-18T00:32:20.643 INFO:teuthology.orchestra.run.smithi081.stdout:2443 write 0xdcf1093 thru 0xdcfe19e (0xd10c bytes) 2024-09-18T00:32:20.646 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:20.645+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:20.662 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:20.662 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:20.662 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:20.662 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:20.663 INFO:teuthology.orchestra.run.smithi081.stdout:2445 punch from 0xb24c201 to 0xb25244e, (0x624d bytes) 2024-09-18T00:32:20.663 INFO:teuthology.orchestra.run.smithi081.stdout:2446 writesame 0xa627f94 thru 0xa636f0e data_size 0x1(0xef7b bytes) 2024-09-18T00:32:20.671 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:20.705 INFO:teuthology.orchestra.run.smithi081.stdout:2447 read 0x2492166 thru 0x2497084 (0x4f1f bytes) 2024-09-18T00:32:20.706 INFO:teuthology.orchestra.run.smithi081.stdout:2448 read 0xcccf478 thru 0xccd7a8d (0x8616 bytes) 2024-09-18T00:32:20.709 INFO:teuthology.orchestra.run.smithi081.stdout:2450 trunc from 0xed6a5ac to 0xbce2d05 2024-09-18T00:32:20.744 INFO:teuthology.orchestra.run.smithi081.stdout:2452 writesame 0x1a08e24 thru 0x1a18127 data_size 0x4(0xf304 bytes) 2024-09-18T00:32:20.747 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:20.744+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:20.772 INFO:teuthology.orchestra.run.smithi081.stdout:2453 trunc from 0xbce2d05 to 0x7cc675a 2024-09-18T00:32:20.800 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:20.811 INFO:teuthology.orchestra.run.smithi081.stdout:2456 writesame 0xc5cbdda thru 0xc5db85f data_size 0x15(0xfa86 bytes) 2024-09-18T00:32:20.824 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:20.824 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:20.825 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:20.825 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:20.825 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:20.825 INFO:teuthology.orchestra.run.smithi081.stdout:2457 trunc from 0xc5db860 to 0xc1033 2024-09-18T00:32:20.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:20.848 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:20.845+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:20.853 INFO:teuthology.orchestra.run.smithi081.stdout:2458 write 0x58a251e thru 0x58a3624 (0x1107 bytes) 2024-09-18T00:32:20.874 INFO:teuthology.orchestra.run.smithi081.stdout:2459 writesame 0xdf006de thru 0xdf07691 data_size 0x6(0x6fb4 bytes) 2024-09-18T00:32:20.886 INFO:teuthology.orchestra.run.smithi081.stdout:2461 trunc from 0xdf07692 to 0x3db6fb3 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2463 punch from 0x2f7cc9d to 0x2f8b108, (0xe46b bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2464 read 0x3571d86 thru 0x3572626 (0x8a1 bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2465 read 0x79df1e thru 0x7aa790 (0xc873 bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2467 read 0x3765e15 thru 0x3774ccb (0xeeb7 bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2468 read 0x10f4d36 thru 0x11016f9 (0xc9c4 bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2469 read 0x177f27e thru 0x178e1e0 (0xef63 bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2470 punch from 0x2c7449 to 0x2d456d, (0xd124 bytes) 2024-09-18T00:32:20.898 INFO:teuthology.orchestra.run.smithi081.stdout:2471 punch from 0x10d3cb5 to 0x10e0125, (0xc470 bytes) 2024-09-18T00:32:20.905 INFO:teuthology.orchestra.run.smithi081.stdout:2473 trunc from 0x3db6fb3 to 0xa32a037 2024-09-18T00:32:20.923 INFO:teuthology.orchestra.run.smithi081.stdout:2474 write 0xe51b367 thru 0xe520f8e (0x5c28 bytes) 2024-09-18T00:32:20.932 INFO:teuthology.orchestra.run.smithi081.stdout:2476 read 0x554eb3b thru 0x5556ab4 (0x7f7a bytes) 2024-09-18T00:32:20.933 INFO:teuthology.orchestra.run.smithi081.stdout:2477 writesame 0xc27fb13 thru 0xc28eb25 data_size 0x1(0xf013 bytes) 2024-09-18T00:32:20.948 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8014749349999999, 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.949 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:20.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8014544719999996, 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8014350770000007, 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8014159220000003, 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8013964920000003, 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8013768369999994, 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8013578429999999, 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8013189179999998, 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8012988379999992, 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8012790939999999, 2024-09-18T00:32:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8012593149999994, 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8012397270000005, 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8012102609999996, 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8011799279999998, 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8011531979999997, 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8011258009999995, 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8011001580000006, 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8010752520000004, 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8010410809999993, 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 8.8010031610000006, 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.039 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:21.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:32:21.040 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:20.946+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:21.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:21.043 INFO:teuthology.orchestra.run.smithi081.stdout:2479 writesame 0x57feab thru 0x58423b data_size 0x7(0x4391 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2480 read 0x1ed9186 thru 0x1ee77d1 (0xe64c bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2481 read 0xad3ee7b thru 0xad43a52 (0x4bd8 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2483 write 0x3d1f8cc thru 0x3d2c387 (0xcabc bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2484 punch from 0xb733021 to 0xb73b330, (0x830f bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2485 write 0x8941212 thru 0x8942d77 (0x1b66 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2488 punch from 0xc51016d to 0xc5199b5, (0x9848 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2490 read 0x670790 thru 0x671207 (0xa78 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2491 read 0x51e8e97 thru 0x51f639d (0xd507 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2492 read 0x6d2268f thru 0x6d2d3d0 (0xad42 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2493 read 0x39f9561 thru 0x39fcefb (0x399b bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2494 punch from 0x39e57f6 to 0x39eaa70, (0x527a bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2495 punch from 0x974bb86 to 0x974c1d8, (0x652 bytes) 2024-09-18T00:32:21.044 INFO:teuthology.orchestra.run.smithi081.stdout:2496 read 0x7208b6f thru 0x72150d6 (0xc568 bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2497 read 0x725a8f2 thru 0x72672d8 (0xc9e7 bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2498 write 0xa7b4979 thru 0xa7b86c3 (0x3d4b bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2499 write 0x5f2810d thru 0x5f36a94 (0xe988 bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2500 read 0x47b418b thru 0x47b5018 (0xe8e bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2501 write 0xffd380 thru 0x1009f85 (0xcc06 bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2503 read 0x99b8853 thru 0x99bb992 (0x3140 bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2504 write 0xda8a585 thru 0xda979d1 (0xd44d bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2505 write 0x5c5e31 thru 0x5cb2a2 (0x5472 bytes) 2024-09-18T00:32:21.045 INFO:teuthology.orchestra.run.smithi081.stdout:2507 write 0xa5152ec thru 0xa520613 (0xb328 bytes) 2024-09-18T00:32:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:2508 punch from 0x6e66efe to 0x6e75913, (0xea15 bytes) 2024-09-18T00:32:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:2509 read 0x871d22c thru 0x872bfd9 (0xedae bytes) 2024-09-18T00:32:21.055 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:21.052+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:21.067 INFO:teuthology.orchestra.run.smithi081.stdout:2510 trunc from 0xe520f8f to 0x3ee003f 2024-09-18T00:32:21.099 INFO:teuthology.orchestra.run.smithi081.stdout:2511 write 0x9997734 thru 0x999df5d (0x682a bytes) 2024-09-18T00:32:21.107 INFO:teuthology.orchestra.run.smithi081.stdout:2512 punch from 0x6ea2104 to 0x6eae4c9, (0xc3c5 bytes) 2024-09-18T00:32:21.107 INFO:teuthology.orchestra.run.smithi081.stdout:2514 trunc from 0x999df5e to 0x97ad06e 2024-09-18T00:32:21.116 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.117 INFO:teuthology.orchestra.run.smithi081.stdout:2516 flatten 2024-09-18T00:32:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:2518 read 0x7f64eaf thru 0x7f66fc0 (0x2112 bytes) 2024-09-18T00:32:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:2522 punch from 0x1f05b2f to 0x1f1330a, (0xd7db bytes) 2024-09-18T00:32:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.124 INFO:teuthology.orchestra.run.smithi081.stdout:2525 writesame 0x4387b83 thru 0x4394f93 data_size 0x1(0xd411 bytes) 2024-09-18T00:32:21.150 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:21.148+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:21.155 INFO:teuthology.orchestra.run.smithi081.stdout:2526 read 0x2d328ce thru 0x2d3f88b (0xcfbe bytes) 2024-09-18T00:32:21.155 INFO:teuthology.orchestra.run.smithi081.stdout:2530 write 0x2a564e6 thru 0x2a57e5c (0x1977 bytes) 2024-09-18T00:32:21.159 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:21.159 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:21.159 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:21.159 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:21.161 INFO:teuthology.orchestra.run.smithi081.stdout:2531 read 0x3615db0 thru 0x3621d60 (0xbfb1 bytes) 2024-09-18T00:32:21.162 INFO:teuthology.orchestra.run.smithi081.stdout:2532 read 0x38c9028 thru 0x38d2f9a (0x9f73 bytes) 2024-09-18T00:32:21.169 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:2533 write 0xd773009 thru 0xd77f74a (0xc742 bytes) 2024-09-18T00:32:21.181 INFO:teuthology.orchestra.run.smithi081.stdout:2534 writesame 0x8eb259c thru 0x8ebf7d3 data_size 0x3e(0xd238 bytes) 2024-09-18T00:32:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:2536 read 0x6037b5a thru 0x6043988 (0xbe2f bytes) 2024-09-18T00:32:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:2537 read 0xcbcdb14 thru 0xcbd5e92 (0x837f bytes) 2024-09-18T00:32:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:2538 write 0x42dbbbd thru 0x42e3310 (0x7754 bytes) 2024-09-18T00:32:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:2539 punch from 0x51a429f to 0x51a4750, (0x4b1 bytes) 2024-09-18T00:32:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:2541 write 0x57b396b thru 0x57b5bbe (0x2254 bytes) 2024-09-18T00:32:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:2543 trunc from 0xd77f74b to 0x865ac70 2024-09-18T00:32:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:2544 read 0x1ff3c4d thru 0x1ffa6ae (0x6a62 bytes) 2024-09-18T00:32:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:2545 read 0x6b58fb7 thru 0x6b59168 (0x1b2 bytes) 2024-09-18T00:32:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:2547 write 0xce111bf thru 0xce194b8 (0x82fa bytes) 2024-09-18T00:32:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:2550 punch from 0x9e680b0 to 0x9e6c1e5, (0x4135 bytes) 2024-09-18T00:32:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:2553 write 0x409b11e thru 0x40a9a20 (0xe903 bytes) 2024-09-18T00:32:21.251 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:21.249+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:2555 punch from 0xc2831f3 to 0xc2865f9, (0x3406 bytes) 2024-09-18T00:32:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:2556 read 0x4cefda8 thru 0x4cf46d2 (0x492b bytes) 2024-09-18T00:32:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:2557 punch from 0x7fbf5c0 to 0x7fce470, (0xeeb0 bytes) 2024-09-18T00:32:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:2562 write 0xe1b9140 thru 0xe1c4738 (0xb5f9 bytes) 2024-09-18T00:32:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:2563 read 0xbe14028 thru 0xbe225c8 (0xe5a1 bytes) 2024-09-18T00:32:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:2564 write 0xe9237f5 thru 0xe92a9fb (0x7207 bytes) 2024-09-18T00:32:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:21.283 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:21.283 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:21.284 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:2565 writesame 0x63e5f57 thru 0x63e847e data_size 0x29(0x2528 bytes) 2024-09-18T00:32:21.293 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:2567 write 0x47974f1 thru 0x47a172e (0xa23e bytes) 2024-09-18T00:32:21.325 INFO:teuthology.orchestra.run.smithi081.stdout:2568 trunc from 0xe92a9fc to 0x96d84a 2024-09-18T00:32:21.346 INFO:teuthology.orchestra.run.smithi081.stdout:2569 read 0x6478fc thru 0x64e067 (0x676c bytes) 2024-09-18T00:32:21.346 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.360 INFO:teuthology.orchestra.run.smithi081.stdout:2572 write 0x72621aa thru 0x7268413 (0x626a bytes) 2024-09-18T00:32:21.369 INFO:teuthology.orchestra.run.smithi081.stdout:2574 write 0x33487dc thru 0x3354f4c (0xc771 bytes) 2024-09-18T00:32:21.378 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:21.377+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:21.380 INFO:teuthology.orchestra.run.smithi081.stdout:2575 writesame 0x479ab5f thru 0x47aa0b7 data_size 0x1(0xf559 bytes) 2024-09-18T00:32:21.425 INFO:teuthology.orchestra.run.smithi081.stdout:2577 read 0xddfe22 thru 0xde2cc5 (0x2ea4 bytes) 2024-09-18T00:32:21.425 INFO:teuthology.orchestra.run.smithi081.stdout:2578 write 0x697df33 thru 0x6983186 (0x5254 bytes) 2024-09-18T00:32:21.431 INFO:teuthology.orchestra.run.smithi081.stdout:2579 read 0x2bc2102 thru 0x2bcee2d (0xcd2c bytes) 2024-09-18T00:32:21.431 INFO:teuthology.orchestra.run.smithi081.stdout:2580 read 0x548f3f5 thru 0x5495c24 (0x6830 bytes) 2024-09-18T00:32:21.431 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.431 INFO:teuthology.orchestra.run.smithi081.stdout:2583 punch from 0x4c8e5f0 to 0x4c929c3, (0x43d3 bytes) 2024-09-18T00:32:21.431 INFO:teuthology.orchestra.run.smithi081.stdout:2585 read 0x600e3e8 thru 0x600f66a (0x1283 bytes) 2024-09-18T00:32:21.432 INFO:teuthology.orchestra.run.smithi081.stdout:2586 punch from 0x15da07b to 0x15e35d2, (0x9557 bytes) 2024-09-18T00:32:21.442 INFO:teuthology.orchestra.run.smithi081.stdout:2587 write 0xb7a4698 thru 0xb7a6510 (0x1e79 bytes) 2024-09-18T00:32:21.444 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.641511276999999, 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.445 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:21.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:21.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.449 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.639580834, 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:21.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.639562494, 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.637971773, 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.637928540000001, 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.637730392999998, 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.637576000999999, 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.637362255999999, 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.637163861000001, 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.636803013000002, 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.633522015, 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.633502839999998, 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.631643736000001, 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.631618839000001, 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.631598334, 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.63157958, 2024-09-18T00:32:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.629559299, 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.629540713000001, 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.628704800000001, 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 28.623529634, 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.535 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:21.537 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:21.538 INFO:teuthology.orchestra.run.smithi081.stdout:2588 write 0x89330b9 thru 0x8940177 (0xd0bf bytes) 2024-09-18T00:32:21.538 INFO:teuthology.orchestra.run.smithi081.stdout:2589 write 0x25acf5f thru 0x25b9a34 (0xcad6 bytes) 2024-09-18T00:32:21.538 INFO:teuthology.orchestra.run.smithi081.stdout:2590 writesame 0x14f177a thru 0x14f8b16 data_size 0x1(0x739d bytes) 2024-09-18T00:32:21.538 INFO:teuthology.orchestra.run.smithi081.stdout:2591 write 0xad5857f thru 0xad5d2de (0x4d60 bytes) 2024-09-18T00:32:21.538 INFO:teuthology.orchestra.run.smithi081.stdout:2593 punch from 0x17a81f0 to 0x17a8271, (0x81 bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2594 write 0x1b745c3 thru 0x1b7aae8 (0x6526 bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2595 read 0x923bb85 thru 0x9242a5d (0x6ed9 bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2596 write 0x847b461 thru 0x847fbce (0x476e bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2598 read 0x1d4b15c thru 0x1d529e6 (0x788b bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2599 trunc from 0xb7a6511 to 0xb8f836a 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2601 read 0x6ac4a79 thru 0x6ace9fd (0x9f85 bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2605 write 0x3b5ac75 thru 0x3b68768 (0xdaf4 bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2606 writesame 0xc986bec thru 0xc98eb2b data_size 0x20(0x7f40 bytes) 2024-09-18T00:32:21.539 INFO:teuthology.orchestra.run.smithi081.stdout:2609 read 0x11f7111 thru 0x11fff66 (0x8e56 bytes) 2024-09-18T00:32:21.539 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:21.534+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:21.541 INFO:teuthology.orchestra.run.smithi081.stdout:2610 write 0xe741c6b thru 0xe74e879 (0xcc0f bytes) 2024-09-18T00:32:21.548 INFO:teuthology.orchestra.run.smithi081.stdout:2611 write 0xab3a0b4 thru 0xab3d636 (0x3583 bytes) 2024-09-18T00:32:21.554 INFO:teuthology.orchestra.run.smithi081.stdout:2612 punch from 0xb868b2f to 0xb870a2f, (0x7f00 bytes) 2024-09-18T00:32:21.554 INFO:teuthology.orchestra.run.smithi081.stdout:2614 read 0xbbf1308 thru 0xbbf7944 (0x663d bytes) 2024-09-18T00:32:21.554 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:21.554 INFO:teuthology.orchestra.run.smithi081.stdout:2617 clone 21 order 23 su 2097152 sc 3 2024-09-18T00:32:21.637 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:21.636+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:21.678 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:21.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T00:32:21.680 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:21.681 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:21.681 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:21.681 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:21.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:21.738 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:21.737+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:21.792 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:21.792 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:21.792 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:21.792 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:21.792 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:21.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:21.839 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:21.837+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:21.940 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:21.938+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.944 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.584096245000001, 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:21.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.578747708000002, 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:21.949 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:21.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:21.953 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.575007982999999, 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:21.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:21.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.958 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.574983615000001, 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.959 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:21.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.574971035000001, 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:21.963 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:21.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:21.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.574960759, 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:21.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:21.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:21.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.563106574999999, 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:21.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.978 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.563086205000001, 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:21.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:21.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:21.983 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.561126567999999, 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:21.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.561117298999999, 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:21.988 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:21.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.559103998000001, 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.993 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:21.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:21.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:21.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.559085837000001, 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:21.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:21.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:21.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.001 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.556787954000001, 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:22.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:22.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:22.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.556747504000001, 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:22.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:22.010 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.556652008, 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:22.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.555076282999998, 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:22.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.555055565, 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.019 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.023 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.555032032, 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:22.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:22.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:22.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.555009433999999, 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:22.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.032 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 29.553053877, 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:22.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.038 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T00:32:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:32:22.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:22.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T00:32:22.082 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:22.080+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:22.144 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:22.142+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:22.185 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:22.185 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:22.185 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:22.185 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:22.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:22.220 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-18T00:32:22.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:22.276 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:22.274+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:22.340 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:22.340 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:22.340 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:22.340 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:22.340 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:22.345 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:22.344+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:22.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:22.395 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:22.414 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:22.432 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:22.446 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:22.444+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:22.448 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:22.465 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:22.482 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1631 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 675840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.494 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.139077366999999, 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047626628999999997, 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1631 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353197+0000", 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353198+0000", 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2449999999999999e-06 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353201+0000", 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.399e-06 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353205+0000", 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5760000000000002e-06 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400685+0000", 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047480517999999999 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400769+0000", 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3473000000000005e-05 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400823+0000", 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4137e-05 2024-09-18T00:32:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1632 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.139065302999999, 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047756706000000003, 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.499 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1632 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353209+0000", 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353210+0000", 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.514e-06 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353216+0000", 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3920000000000002e-06 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353219+0000", 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.315e-06 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400849+0000", 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047630231000000002 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400901+0000", 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1428999999999998e-05 2024-09-18T00:32:22.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400965+0000", 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4543999999999997e-05 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1633 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.139050781000002, 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868945000000003, 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.503 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1633 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354886+0000", 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001662979 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354890+0000", 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:22.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354899+0000", 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3510000000000008e-06 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354906+0000", 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5869999999999998e-06 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400994+0000", 2024-09-18T00:32:22.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046087545000000001 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401038+0000", 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4535e-05 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401092+0000", 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3687999999999998e-05 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1682 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 47104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.137165583000002, 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047536968999999998, 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1682 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.508 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:22.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0100000000000001e-07 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355109+0000", 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8899999999999998e-07 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355112+0000", 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8770000000000002e-06 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355115+0000", 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4030000000000001e-06 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402556+0000", 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047441715000000002 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402596+0000", 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9635000000000003e-05 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402645+0000", 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9149e-05 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1683 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.137156124000001, 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047646796999999998, 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1683 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:22.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356882+0000", 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001764334 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356890+0000", 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4759999999999998e-06 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356901+0000", 2024-09-18T00:32:22.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0533999999999999e-05 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356912+0000", 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1239e-05 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402670+0000", 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045757985000000001 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402713+0000", 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3121000000000003e-05 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402764+0000", 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1107999999999999e-05 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1705 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 706560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:22.516 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.133214439, 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047596718000000003, 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1705 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:22.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360881+0000", 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001821802 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360885+0000", 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4809999999999998e-06 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360892+0000", 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360896+0000", 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6140000000000002e-06 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406437+0000", 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045540046000000001 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406544+0000", 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107112 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406656+0000", 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011232500000000001 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.520 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1715 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 993280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.131216396999999, 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047689281, 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.521 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1715 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361058+0000", 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361059+0000", 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.697e-06 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361065+0000", 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.507e-06 2024-09-18T00:32:22.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361069+0000", 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.442e-06 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408546+0000", 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047476566999999997 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408638+0000", 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2218000000000004e-05 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408747+0000", 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108528 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1716 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 1021952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.525 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.131198776000002, 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047884890999999999, 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1716 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361077+0000", 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.823e-06 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361085+0000", 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5889999999999997e-06 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361089+0000", 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.651e-06 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408783+0000", 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047693194000000001 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408861+0000", 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8220000000000007e-05 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408960+0000", 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9049999999999995e-05 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.529 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1754 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 20480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.131178787, 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048097325000000003, 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1754 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361097+0000", 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.714e-06 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361104+0000", 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8580000000000002e-06 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361117+0000", 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3118e-05 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408998+0000", 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047881263 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409088+0000", 2024-09-18T00:32:22.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9918000000000002e-05 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409192+0000", 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104079 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1755 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.131149967999999, 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048258826999999997, 2024-09-18T00:32:22.534 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1755 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.32e-07 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361126+0000", 2024-09-18T00:32:22.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1059999999999998e-06 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361132+0000", 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0299999999999999e-06 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361137+0000", 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409215+0000", 2024-09-18T00:32:22.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048078567000000003 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409294+0000", 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8467999999999995e-05 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409383+0000", 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8840999999999999e-05 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1756 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 77824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.131131308000001, 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048360829000000001, 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1756 2024-09-18T00:32:22.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361143+0000", 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361154+0000", 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1336e-05 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361161+0000", 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2629999999999997e-06 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361171+0000", 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3049999999999998e-06 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409408+0000", 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048237447000000003 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409451+0000", 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3284000000000001e-05 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409503+0000", 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1833000000000003e-05 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1757 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.131095878, 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048438623, 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.543 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1757 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362883+0000", 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017047620000000001 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362887+0000", 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1690000000000002e-06 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362897+0000", 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0362e-05 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362905+0000", 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6369999999999999e-06 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409527+0000", 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046622334000000001 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409566+0000", 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9427e-05 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409616+0000", 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9932000000000002e-05 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1764 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 307200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.547 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.129195159999998, 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047564585999999999, 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1764 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363081+0000", 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.869e-06 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363087+0000", 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.387e-06 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363092+0000", 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410478+0000", 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047385746999999999 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410535+0000", 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7154999999999997e-05 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410643+0000", 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108311 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.551 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1765 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.129175231000001, 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047660415999999997, 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.552 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1765 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363099+0000", 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363102+0000", 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.898e-06 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363108+0000", 2024-09-18T00:32:22.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363118+0000", 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9969999999999993e-06 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410660+0000", 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047542415999999997 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410703+0000", 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2231000000000003e-05 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410759+0000", 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6271999999999999e-05 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1766 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 364544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:22.556 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.129150508999999, 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868621, 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1766 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:22.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363124+0000", 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363125+0000", 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.48e-06 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363129+0000", 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7579999999999998e-06 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363131+0000", 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5320000000000001e-06 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410797+0000", 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047665893000000001 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410892+0000", 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4406000000000004e-05 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410992+0000", 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100191 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.560 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1767 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 393216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.129139179999999, 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047993455999999997, 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1767 2024-09-18T00:32:22.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363135+0000", 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0599999999999999e-07 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363139+0000", 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5249999999999999e-06 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363143+0000", 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3550000000000001e-06 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363145+0000", 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411022+0000", 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047877292000000002 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411073+0000", 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0528999999999997e-05 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411128+0000", 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4923000000000003e-05 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1768 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.129125194, 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048176798, 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1768 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364882+0000", 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733917 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364892+0000", 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.577e-06 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364911+0000", 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8868999999999998e-05 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364917+0000", 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8640000000000001e-06 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411156+0000", 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046238915999999998 2024-09-18T00:32:22.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411220+0000", 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4751000000000004e-05 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411325+0000", 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104904 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1775 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 622592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.127231571999999, 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047673465999999998, 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1775 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.570 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365044+0000", 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1200000000000001e-06 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365047+0000", 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.269e-06 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365049+0000", 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5720000000000001e-06 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412581+0000", 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047531363 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412636+0000", 2024-09-18T00:32:22.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4969999999999997e-05 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412716+0000", 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9861e-05 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1776 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.127221191, 2024-09-18T00:32:22.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047805461, 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1776 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365053+0000", 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365054+0000", 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0189999999999999e-06 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365057+0000", 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0299999999999998e-06 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365059+0000", 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4619999999999999e-06 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412745+0000", 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047685412000000003 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412795+0000", 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9904000000000002e-05 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412858+0000", 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3406999999999998e-05 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.578 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1777 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.127211521, 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047940417999999999, 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:22.579 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1777 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366880+0000", 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018183279999999999 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366884+0000", 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.002e-06 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366896+0000", 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1119e-05 2024-09-18T00:32:22.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366905+0000", 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4930000000000004e-06 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412893+0000", 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045988345999999999 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412947+0000", 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:22.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413003+0000", 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5770999999999998e-05 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:22.584 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:22.585 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:22.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:22.586 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2618 writesame 0x40bbaf6 thru 0x40c01a1 data_size 0x2(0x46ac bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2621 read 0x117d3ba thru 0x118ac54 (0xd89b bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2623 write 0xb3bb4ae thru 0xb3c84ef (0xd042 bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2627 punch from 0xcbda4e6 to 0xcbe5b0f, (0xb629 bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2628 write 0xe1e9dd0 thru 0xe1eddad (0x3fde bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2629 write 0x4b4e8d6 thru 0x4b54710 (0x5e3b bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2630 writesame 0x3564263 thru 0x3570872 data_size 0x8(0xc610 bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2631 read 0x3d7d9e2 thru 0x3d8ae23 (0xd442 bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2635 read 0xe4f73ae thru 0xe4fcf6d (0x5bc0 bytes) 2024-09-18T00:32:22.588 INFO:teuthology.orchestra.run.smithi081.stdout:2636 writesame 0x962f448 thru 0x9637b5d data_size 0x1(0x8716 bytes) 2024-09-18T00:32:22.589 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:22.582+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:22.589 INFO:teuthology.orchestra.run.smithi081.stdout:2639 punch from 0x8ad4666 to 0x8ad5725, (0x10bf bytes) 2024-09-18T00:32:22.598 INFO:teuthology.orchestra.run.smithi081.stdout:2640 trunc from 0xe74e87a to 0x556c131 2024-09-18T00:32:22.618 INFO:teuthology.orchestra.run.smithi081.stdout:2641 read 0x3944e8e thru 0x394a782 (0x58f5 bytes) 2024-09-18T00:32:22.618 INFO:teuthology.orchestra.run.smithi081.stdout:2642 punch from 0x489a224 to 0x489cc2e, (0x2a0a bytes) 2024-09-18T00:32:22.618 INFO:teuthology.orchestra.run.smithi081.stdout:2643 read 0x15e446d thru 0x15e4689 (0x21d bytes) 2024-09-18T00:32:22.629 INFO:teuthology.orchestra.run.smithi081.stdout:2644 write 0xa2df1b5 thru 0xa2ed691 (0xe4dd bytes) 2024-09-18T00:32:22.632 INFO:teuthology.orchestra.run.smithi081.stdout:2645 read 0x9ed1ef0 thru 0x9ed9b99 (0x7caa bytes) 2024-09-18T00:32:22.632 INFO:teuthology.orchestra.run.smithi081.stdout:2647 punch from 0x834a28a to 0x83551a7, (0xaf1d bytes) 2024-09-18T00:32:22.632 INFO:teuthology.orchestra.run.smithi081.stdout:2648 write 0x3081de4 thru 0x308eb4b (0xcd68 bytes) 2024-09-18T00:32:22.638 INFO:teuthology.orchestra.run.smithi081.stdout:2649 trunc from 0xa2ed692 to 0xbcf6446 2024-09-18T00:32:22.643 INFO:teuthology.orchestra.run.smithi081.stdout:2650 write 0x9d2a89a thru 0x9d375d2 (0xcd39 bytes) 2024-09-18T00:32:22.652 INFO:teuthology.orchestra.run.smithi081.stdout:2651 write 0xd4d9b6c thru 0xd4db11c (0x15b1 bytes) 2024-09-18T00:32:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:2652 punch from 0x5d0cd3f to 0x5d0e0be, (0x137f bytes) 2024-09-18T00:32:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:2654 read 0x69937a3 thru 0x6999b22 (0x6380 bytes) 2024-09-18T00:32:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:2655 punch from 0xa735a35 to 0xa7360ce, (0x699 bytes) 2024-09-18T00:32:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:2656 punch from 0xb5f1579 to 0xb5f89c6, (0x744d bytes) 2024-09-18T00:32:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:2657 writesame 0x4ca9b73 thru 0x4cb5b06 data_size 0x86(0xbf94 bytes) 2024-09-18T00:32:22.657 INFO:teuthology.orchestra.run.smithi081.stdout:2658 punch from 0xc4898e7 to 0xc4920f5, (0x880e bytes) 2024-09-18T00:32:22.657 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.657 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.657 INFO:teuthology.orchestra.run.smithi081.stdout:2665 read 0x948d557 thru 0x948d7f0 (0x29a bytes) 2024-09-18T00:32:22.663 INFO:teuthology.orchestra.run.smithi081.stdout:2667 write 0xeaa79aa thru 0xeaaa940 (0x2f97 bytes) 2024-09-18T00:32:22.667 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.667 INFO:teuthology.orchestra.run.smithi081.stdout:2670 writesame 0x89e01e4 thru 0x89ec5e0 data_size 0x1(0xc3fd bytes) 2024-09-18T00:32:22.685 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:22.683+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:22.695 INFO:teuthology.orchestra.run.smithi081.stdout:2671 read 0x90940be thru 0x90a2752 (0xe695 bytes) 2024-09-18T00:32:22.697 INFO:teuthology.orchestra.run.smithi081.stdout:2673 read 0xcf1d3b0 thru 0xcf295b3 (0xc204 bytes) 2024-09-18T00:32:22.698 INFO:teuthology.orchestra.run.smithi081.stdout:2675 writesame 0x3037ca2 thru 0x3043457 data_size 0x5(0xb7b6 bytes) 2024-09-18T00:32:22.702 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:22.702 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:22.705 INFO:teuthology.orchestra.run.smithi081.stdout:2676 writesame 0xcc1edd1 thru 0xcc23b6f data_size 0x1(0x4d9f bytes) 2024-09-18T00:32:22.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:22.717 INFO:teuthology.orchestra.run.smithi081.stdout:2677 read 0x2bcacc7 thru 0x2bcc269 (0x15a3 bytes) 2024-09-18T00:32:22.717 INFO:teuthology.orchestra.run.smithi081.stdout:2678 writesame 0xdda1b0e thru 0xdda94b8 data_size 0x1(0x79ab bytes) 2024-09-18T00:32:22.734 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.735 INFO:teuthology.orchestra.run.smithi081.stdout:2681 read 0x5348fd1 thru 0x534d5ea (0x461a bytes) 2024-09-18T00:32:22.736 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.736 INFO:teuthology.orchestra.run.smithi081.stdout:2683 write 0x158e713 thru 0x159b196 (0xca84 bytes) 2024-09-18T00:32:22.741 INFO:teuthology.orchestra.run.smithi081.stdout:2684 writesame 0x5dca120 thru 0x5dd912e data_size 0x55(0xf00f bytes) 2024-09-18T00:32:22.744 INFO:teuthology.orchestra.run.smithi081.stdout:2685 read 0x46d248b thru 0x46d63b9 (0x3f2f bytes) 2024-09-18T00:32:22.744 INFO:teuthology.orchestra.run.smithi081.stdout:2686 write 0x7d0ea60 thru 0x7d1bc39 (0xd1da bytes) 2024-09-18T00:32:22.746 INFO:teuthology.orchestra.run.smithi081.stdout:2687 read 0x50d8e42 thru 0x50e24a5 (0x9664 bytes) 2024-09-18T00:32:22.747 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.747 INFO:teuthology.orchestra.run.smithi081.stdout:2690 read 0x1186f39 thru 0x118da6d (0x6b35 bytes) 2024-09-18T00:32:22.747 INFO:teuthology.orchestra.run.smithi081.stdout:2692 write 0x2c0532a thru 0x2c12317 (0xcfee bytes) 2024-09-18T00:32:22.764 INFO:teuthology.orchestra.run.smithi081.stdout:2694 trunc from 0xeaaa941 to 0x4744876 2024-09-18T00:32:22.780 INFO:teuthology.orchestra.run.smithi081.stdout:2696 read 0x331ee8f thru 0x3323597 (0x4709 bytes) 2024-09-18T00:32:22.780 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.780 INFO:teuthology.orchestra.run.smithi081.stdout:2698 read 0x4738785 thru 0x473cd20 (0x459c bytes) 2024-09-18T00:32:22.780 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.786 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:22.784+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:22.787 INFO:teuthology.orchestra.run.smithi081.stdout:2702 trunc from 0x4744876 to 0xa7330d8 2024-09-18T00:32:22.792 INFO:teuthology.orchestra.run.smithi081.stdout:2704 read 0x5e21f7 thru 0x5e95b1 (0x73bb bytes) 2024-09-18T00:32:22.793 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.793 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.802 INFO:teuthology.orchestra.run.smithi081.stdout:2707 write 0xd4cdcfc thru 0xd4dbaa5 (0xddaa bytes) 2024-09-18T00:32:22.805 INFO:teuthology.orchestra.run.smithi081.stdout:2708 write 0x9ece207 thru 0x9ed27bc (0x45b6 bytes) 2024-09-18T00:32:22.809 INFO:teuthology.orchestra.run.smithi081.stdout:2709 trunc from 0xd4dbaa6 to 0xd144a11 2024-09-18T00:32:22.815 INFO:teuthology.orchestra.run.smithi081.stdout:2710 flatten 2024-09-18T00:32:22.835 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:22.835 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:22.835 INFO:teuthology.orchestra.run.smithi081.stdout:2713 write 0xd6125b7 thru 0xd616b6b (0x45b5 bytes) 2024-09-18T00:32:22.839 INFO:teuthology.orchestra.run.smithi081.stdout:2715 writesame 0x13fa8cc thru 0x14025c2 data_size 0x1(0x7cf7 bytes) 2024-09-18T00:32:22.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:2716 writesame 0x57f97b2 thru 0x5803739 data_size 0x14(0x9f88 bytes) 2024-09-18T00:32:22.869 INFO:teuthology.orchestra.run.smithi081.stdout:2718 read 0xa762dd0 thru 0xa76aa99 (0x7cca bytes) 2024-09-18T00:32:22.870 INFO:teuthology.orchestra.run.smithi081.stdout:2719 write 0x4be7e7e thru 0x4bf1e75 (0x9ff8 bytes) 2024-09-18T00:32:22.871 INFO:teuthology.orchestra.run.smithi081.stdout:2720 read 0x73493 thru 0x81904 (0xe472 bytes) 2024-09-18T00:32:22.872 INFO:teuthology.orchestra.run.smithi081.stdout:2721 read 0x326bc0a thru 0x327165e (0x5a55 bytes) 2024-09-18T00:32:22.872 INFO:teuthology.orchestra.run.smithi081.stdout:2722 read 0x44e3688 thru 0x44f3327 (0xfca0 bytes) 2024-09-18T00:32:22.873 INFO:teuthology.orchestra.run.smithi081.stdout:2723 write 0xd2c2c4a thru 0xd2d2b15 (0xfecc bytes) 2024-09-18T00:32:22.876 INFO:teuthology.orchestra.run.smithi081.stdout:2725 read 0x6ac8fe4 thru 0x6ad2578 (0x9595 bytes) 2024-09-18T00:32:22.876 INFO:teuthology.orchestra.run.smithi081.stdout:2727 writesame 0xac1589d thru 0xac1d6bc data_size 0x4(0x7e20 bytes) 2024-09-18T00:32:22.882 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.883 INFO:teuthology.orchestra.run.smithi081.stdout:2729 read 0x3d9f227 thru 0x3da2e7f (0x3c59 bytes) 2024-09-18T00:32:22.883 INFO:teuthology.orchestra.run.smithi081.stdout:2730 writesame 0xcace554 thru 0xcada1e2 data_size 0x1(0xbc8f bytes) 2024-09-18T00:32:22.887 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:22.886+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:22.915 INFO:teuthology.orchestra.run.smithi081.stdout:2733 punch from 0xb6360 to 0xbf526, (0x91c6 bytes) 2024-09-18T00:32:22.915 INFO:teuthology.orchestra.run.smithi081.stdout:2734 writesame 0x4123aa4 thru 0x412db20 data_size 0x63(0xa07d bytes) 2024-09-18T00:32:22.916 INFO:teuthology.orchestra.run.smithi081.stdout:2735 write 0xcda910d thru 0xcdb4a09 (0xb8fd bytes) 2024-09-18T00:32:22.918 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.930 INFO:teuthology.orchestra.run.smithi081.stdout:2738 trunc from 0xd616b6c to 0x37669fa 2024-09-18T00:32:22.946 INFO:teuthology.orchestra.run.smithi081.stdout:2739 punch from 0xc598bb to 0xc643e4, (0xab29 bytes) 2024-09-18T00:32:22.946 INFO:teuthology.orchestra.run.smithi081.stdout:2740 read 0x10dda76 thru 0x10e7ef1 (0xa47c bytes) 2024-09-18T00:32:22.959 INFO:teuthology.orchestra.run.smithi081.stdout:2741 write 0x9ba290a thru 0x9ba2c20 (0x317 bytes) 2024-09-18T00:32:22.970 INFO:teuthology.orchestra.run.smithi081.stdout:2743 write 0xc94a62e thru 0xc953215 (0x8be8 bytes) 2024-09-18T00:32:22.973 INFO:teuthology.orchestra.run.smithi081.stdout:2744 write 0x6619fd0 thru 0x6627ef0 (0xdf21 bytes) 2024-09-18T00:32:22.977 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:22.977 INFO:teuthology.orchestra.run.smithi081.stdout:2747 write 0xa04da84 thru 0xa0547b5 (0x6d32 bytes) 2024-09-18T00:32:22.978 INFO:teuthology.orchestra.run.smithi081.stdout:2748 read 0x6db6fdf thru 0x6dbcf6c (0x5f8e bytes) 2024-09-18T00:32:22.979 INFO:teuthology.orchestra.run.smithi081.stdout:2749 read 0xb0cc549 thru 0xb0d4edd (0x8995 bytes) 2024-09-18T00:32:22.979 INFO:teuthology.orchestra.run.smithi081.stdout:2750 read 0xc5a43bd thru 0xc5a443a (0x7e bytes) 2024-09-18T00:32:22.979 INFO:teuthology.orchestra.run.smithi081.stdout:2751 write 0x719f499 thru 0x71aa928 (0xb490 bytes) 2024-09-18T00:32:22.982 INFO:teuthology.orchestra.run.smithi081.stdout:2752 write 0x9a57e8 thru 0x9af4d5 (0x9cee bytes) 2024-09-18T00:32:22.984 INFO:teuthology.orchestra.run.smithi081.stdout:2753 punch from 0x98fc531 to 0x9906c08, (0xa6d7 bytes) 2024-09-18T00:32:22.984 INFO:teuthology.orchestra.run.smithi081.stdout:2754 punch from 0xaca8eb4 to 0xacb65d3, (0xd71f bytes) 2024-09-18T00:32:22.984 INFO:teuthology.orchestra.run.smithi081.stdout:2757 read 0xd91327 thru 0xd9f412 (0xe0ec bytes) 2024-09-18T00:32:22.985 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:22.986 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:22.988 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:22.986+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:22.991 INFO:teuthology.orchestra.run.smithi081.stdout:2758 write 0xdfff3d3 thru 0xe00a3c3 (0xaff1 bytes) 2024-09-18T00:32:22.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:23.001 INFO:teuthology.orchestra.run.smithi081.stdout:2759 write 0xe92ecef thru 0xe9320af (0x33c1 bytes) 2024-09-18T00:32:23.003 INFO:teuthology.orchestra.run.smithi081.stdout:2760 read 0x3039864 thru 0x303a791 (0xf2e bytes) 2024-09-18T00:32:23.004 INFO:teuthology.orchestra.run.smithi081.stdout:2761 read 0xecc7f thru 0xf7fe8 (0xb36a bytes) 2024-09-18T00:32:23.005 INFO:teuthology.orchestra.run.smithi081.stdout:2762 read 0x9dada26 thru 0x9dbb1fe (0xd7d9 bytes) 2024-09-18T00:32:23.005 INFO:teuthology.orchestra.run.smithi081.stdout:2763 punch from 0x8d656ce to 0x8d70061, (0xa993 bytes) 2024-09-18T00:32:23.005 INFO:teuthology.orchestra.run.smithi081.stdout:2764 write 0x1cd6a65 thru 0x1ce185a (0xadf6 bytes) 2024-09-18T00:32:23.009 INFO:teuthology.orchestra.run.smithi081.stdout:2765 read 0x3c22dc7 thru 0x3c3294c (0xfb86 bytes) 2024-09-18T00:32:23.010 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.010 INFO:teuthology.orchestra.run.smithi081.stdout:2767 write 0xc6668a4 thru 0xc66d3c2 (0x6b1f bytes) 2024-09-18T00:32:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T00:32:23.013 INFO:teuthology.orchestra.run.smithi081.stdout:2769 punch from 0x648ced5 to 0x649ba0d, (0xeb38 bytes) 2024-09-18T00:32:23.030 INFO:teuthology.orchestra.run.smithi081.stdout:2770 trunc from 0xe9320b0 to 0x19e8229 2024-09-18T00:32:23.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T00:32:23.065 INFO:teuthology.orchestra.run.smithi081.stdout:2771 write 0x5637e03 thru 0x563eff8 (0x71f6 bytes) 2024-09-18T00:32:23.069 INFO:teuthology.orchestra.run.smithi081.stdout:2772 write 0x6b9f70 thru 0x6c71a8 (0xd239 bytes) 2024-09-18T00:32:23.070 INFO:teuthology.orchestra.run.smithi081.stdout:2774 writesame 0x715c3f thru 0x716326 data_size 0x1a(0x6e8 bytes) 2024-09-18T00:32:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:2775 read 0x3b8391e thru 0x3b934a8 (0xfb8b bytes) 2024-09-18T00:32:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:2777 punch from 0x4c46ab1 to 0x4c4b736, (0x4c85 bytes) 2024-09-18T00:32:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:2781 read 0x39564f6 thru 0x395811b (0x1c26 bytes) 2024-09-18T00:32:23.073 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.077 INFO:teuthology.orchestra.run.smithi081.stdout:2784 trunc from 0x563eff9 to 0x965a552 2024-09-18T00:32:23.082 INFO:teuthology.orchestra.run.smithi081.stdout:2785 read 0x2c70bfc thru 0x2c72c84 (0x2089 bytes) 2024-09-18T00:32:23.082 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.082 INFO:teuthology.orchestra.run.smithi081.stdout:2788 writesame 0x1a29c80 thru 0x1a30a59 data_size 0x6d(0x6dda bytes) 2024-09-18T00:32:23.086 INFO:teuthology.orchestra.run.smithi081.stdout:2789 punch from 0x3774632 to 0x377cd81, (0x874f bytes) 2024-09-18T00:32:23.087 INFO:teuthology.orchestra.run.smithi081.stdout:2790 trunc from 0x965a552 to 0x831ba41 2024-09-18T00:32:23.088 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:23.087+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:23.099 INFO:teuthology.orchestra.run.smithi081.stdout:2792 write 0x8cb085b thru 0x8cb42ca (0x3a70 bytes) 2024-09-18T00:32:23.103 INFO:teuthology.orchestra.run.smithi081.stdout:2794 writesame 0x39e9f6a thru 0x39f6026 data_size 0x1(0xc0bd bytes) 2024-09-18T00:32:23.130 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.130 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:23.140 INFO:teuthology.orchestra.run.smithi081.stdout:2795 read 0x2f2fa48 thru 0x2f39f29 (0xa4e2 bytes) 2024-09-18T00:32:23.140 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.149 INFO:teuthology.orchestra.run.smithi081.stdout:2799 trunc from 0x8cb42cb to 0x1139b2a 2024-09-18T00:32:23.166 INFO:teuthology.orchestra.run.smithi081.stdout:2803 read 0x8ee7aa thru 0x8f5c1b (0x7472 bytes) 2024-09-18T00:32:23.166 INFO:teuthology.orchestra.run.smithi081.stdout:2804 read 0x25e0ed thru 0x2657b9 (0x76cd bytes) 2024-09-18T00:32:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:2805 trunc from 0x1139b2a to 0xe6aff27 2024-09-18T00:32:23.188 INFO:teuthology.orchestra.run.smithi081.stdout:2806 write 0x798ccaf thru 0x7992e06 (0x6158 bytes) 2024-09-18T00:32:23.189 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:23.186+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:23.193 INFO:teuthology.orchestra.run.smithi081.stdout:2811 write 0x14d7eb9 thru 0x14dcf2c (0x5074 bytes) 2024-09-18T00:32:23.202 INFO:teuthology.orchestra.run.smithi081.stdout:2812 trunc from 0xe6aff27 to 0x7b7c31f 2024-09-18T00:32:23.209 INFO:teuthology.orchestra.run.smithi081.stdout:2813 read 0x5412cd1 thru 0x5421e8b (0xf1bb bytes) 2024-09-18T00:32:23.216 INFO:teuthology.orchestra.run.smithi081.stdout:2814 write 0x949cd4e thru 0x94a2721 (0x59d4 bytes) 2024-09-18T00:32:23.220 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.220 INFO:teuthology.orchestra.run.smithi081.stdout:2816 read 0x7ced547 thru 0x7cf63cc (0x8e86 bytes) 2024-09-18T00:32:23.220 INFO:teuthology.orchestra.run.smithi081.stdout:2817 write 0x1690de thru 0x1763ca (0xd2ed bytes) 2024-09-18T00:32:23.222 INFO:teuthology.orchestra.run.smithi081.stdout:2818 punch from 0xa51c7c to 0xa5856b, (0x68ef bytes) 2024-09-18T00:32:23.222 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.229 INFO:teuthology.orchestra.run.smithi081.stdout:2821 write 0xa0afc39 thru 0xa0b8f57 (0x931f bytes) 2024-09-18T00:32:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:2823 writesame 0xcf0467b thru 0xcf0c66a data_size 0x8(0x7ff0 bytes) 2024-09-18T00:32:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:2826 punch from 0x3221047 to 0x3227923, (0x68dc bytes) 2024-09-18T00:32:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:2830 write 0x254ed5 thru 0x2576be (0x27ea bytes) 2024-09-18T00:32:23.259 INFO:teuthology.orchestra.run.smithi081.stdout:2833 trunc from 0xcf0c66b to 0x18b68b4 2024-09-18T00:32:23.272 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.272 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.277 INFO:teuthology.orchestra.run.smithi081.stdout:2834 writesame 0x36416d7 thru 0x3643d8f data_size 0x1(0x26b9 bytes) 2024-09-18T00:32:23.278 INFO:teuthology.orchestra.run.smithi081.stdout:2835 trunc from 0x3643d90 to 0x37fb4a3 2024-09-18T00:32:23.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:23.283 INFO:teuthology.orchestra.run.smithi081.stdout:2837 read 0x176a900 thru 0x1776612 (0xbd13 bytes) 2024-09-18T00:32:23.283 INFO:teuthology.orchestra.run.smithi081.stdout:2838 read 0x34a2fd4 thru 0x34aa235 (0x7262 bytes) 2024-09-18T00:32:23.312 INFO:teuthology.orchestra.run.smithi081.stdout:2839 writesame 0xa7da6de thru 0xa7e96a2 data_size 0x1(0xefc5 bytes) 2024-09-18T00:32:23.313 INFO:teuthology.orchestra.run.smithi081.stdout:2840 read 0x71cbc39 thru 0x71d6043 (0xa40b bytes) 2024-09-18T00:32:23.313 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:23.310+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:23.324 INFO:teuthology.orchestra.run.smithi081.stdout:2841 trunc from 0xa7e96a3 to 0x180d68b 2024-09-18T00:32:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:2842 write 0x8ab3b0f thru 0x8abbc77 (0x8169 bytes) 2024-09-18T00:32:23.349 INFO:teuthology.orchestra.run.smithi081.stdout:2843 writesame 0x6a50dd0 thru 0x6a50f25 data_size 0x1(0x156 bytes) 2024-09-18T00:32:23.359 INFO:teuthology.orchestra.run.smithi081.stdout:2846 write 0x8be7c76 thru 0x8bf191a (0x9ca5 bytes) 2024-09-18T00:32:23.361 INFO:teuthology.orchestra.run.smithi081.stdout:2848 read 0x6fbfa9c thru 0x6fc6dad (0x7312 bytes) 2024-09-18T00:32:23.361 INFO:teuthology.orchestra.run.smithi081.stdout:2849 punch from 0x54dde60 to 0x54e6050, (0x81f0 bytes) 2024-09-18T00:32:23.361 INFO:teuthology.orchestra.run.smithi081.stdout:2851 write 0x2ce6362 thru 0x2ce9b92 (0x3831 bytes) 2024-09-18T00:32:23.364 INFO:teuthology.orchestra.run.smithi081.stdout:2852 clone 22 order 25 su 16777216 sc 9 2024-09-18T00:32:23.390 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:23.389+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:23.396 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.396 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:23.491 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:23.489+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:23.548 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.548 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:23.597 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:23.595+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:23.693 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:23.690+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:23.699 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.699 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:23.794 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:23.793+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:23.851 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.851 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:23.895 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:23.894+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:23.962 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:23.962 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:23.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:23.996 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:23.995+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T00:32:24.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T00:32:24.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:32:24.084 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:24.084 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:24.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:24.097 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:24.096+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:24.181 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-18T00:32:24.197 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:24.196+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:24.271 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:24.271 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:24.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:24.328 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:24.327+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:24.391 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:24.391 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:24.398 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:24.397+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:24.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:24.500 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:24.497+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:24.543 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:24.543 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:24.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:2854 trunc from 0x8bf191b to 0x5121e4e 2024-09-18T00:32:24.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:24.593 INFO:teuthology.orchestra.run.smithi081.stdout:2856 punch from 0x123a66f to 0x123aad1, (0x462 bytes) 2024-09-18T00:32:24.593 INFO:teuthology.orchestra.run.smithi081.stdout:2857 read 0x49621af thru 0x4966acd (0x491f bytes) 2024-09-18T00:32:24.593 INFO:teuthology.orchestra.run.smithi081.stdout:2858 read 0x1f67245 thru 0x1f6c0b7 (0x4e73 bytes) 2024-09-18T00:32:24.593 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.598 INFO:teuthology.orchestra.run.smithi081.stdout:2860 trunc from 0x5121e4e to 0xa284a2e 2024-09-18T00:32:24.601 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:24.598+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:24.604 INFO:teuthology.orchestra.run.smithi081.stdout:2861 read 0x47f7deb thru 0x47fbb0b (0x3d21 bytes) 2024-09-18T00:32:24.614 INFO:teuthology.orchestra.run.smithi081.stdout:2862 trunc from 0xa284a2e to 0x1b2313d 2024-09-18T00:32:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:2863 punch from 0x10e4bb7 to 0x10f0f7f, (0xc3c8 bytes) 2024-09-18T00:32:24.641 INFO:teuthology.orchestra.run.smithi081.stdout:2865 write 0x95c06b4 thru 0x95cc9ce (0xc31b bytes) 2024-09-18T00:32:24.650 INFO:teuthology.orchestra.run.smithi081.stdout:2867 trunc from 0x95cc9cf to 0xe8e360e 2024-09-18T00:32:24.654 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.654 INFO:teuthology.orchestra.run.smithi081.stdout:2872 read 0x38a7f65 thru 0x38aa11b (0x21b7 bytes) 2024-09-18T00:32:24.654 INFO:teuthology.orchestra.run.smithi081.stdout:2874 punch from 0xbd8ee9 to 0xbdc78c, (0x38a3 bytes) 2024-09-18T00:32:24.654 INFO:teuthology.orchestra.run.smithi081.stdout:2877 writesame 0x3aac80d thru 0x3ab320c data_size 0x6a(0x6a00 bytes) 2024-09-18T00:32:24.657 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.658 INFO:teuthology.orchestra.run.smithi081.stdout:2879 punch from 0x411af9 to 0x419df1, (0x82f8 bytes) 2024-09-18T00:32:24.658 INFO:teuthology.orchestra.run.smithi081.stdout:2880 read 0x27b4be3 thru 0x27babad (0x5fcb bytes) 2024-09-18T00:32:24.658 INFO:teuthology.orchestra.run.smithi081.stdout:2883 read 0x2dbf225 thru 0x2dce5b2 (0xf38e bytes) 2024-09-18T00:32:24.658 INFO:teuthology.orchestra.run.smithi081.stdout:2884 read 0x2b8e15a thru 0x2b98128 (0x9fcf bytes) 2024-09-18T00:32:24.658 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:24.658 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:24.667 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:24.668 INFO:teuthology.orchestra.run.smithi081.stdout:2885 trunc from 0xe8e360e to 0x56c02c3 2024-09-18T00:32:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:2886 write 0xdcaa492 thru 0xdcb2734 (0x82a3 bytes) 2024-09-18T00:32:24.696 INFO:teuthology.orchestra.run.smithi081.stdout:2887 writesame 0xa6e8547 thru 0xa6e8a71 data_size 0x9(0x52b bytes) 2024-09-18T00:32:24.698 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.698 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.698 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.705 INFO:teuthology.orchestra.run.smithi081.stdout:2893 trunc from 0xdcb2735 to 0x767b1fb 2024-09-18T00:32:24.711 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:24.710+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:24.712 INFO:teuthology.orchestra.run.smithi081.stdout:2896 punch from 0x54b858d to 0x54bf803, (0x7276 bytes) 2024-09-18T00:32:24.713 INFO:teuthology.orchestra.run.smithi081.stdout:2897 write 0x3687fca thru 0x3694503 (0xc53a bytes) 2024-09-18T00:32:24.714 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.714 INFO:teuthology.orchestra.run.smithi081.stdout:2901 writesame 0x356620c thru 0x356a234 data_size 0x2d(0x4029 bytes) 2024-09-18T00:32:24.717 INFO:teuthology.orchestra.run.smithi081.stdout:2902 trunc from 0x767b1fb to 0x62daad2 2024-09-18T00:32:24.725 INFO:teuthology.orchestra.run.smithi081.stdout:2903 trunc from 0x62daad2 to 0x7e6cf55 2024-09-18T00:32:24.728 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:24.728 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:24.730 INFO:teuthology.orchestra.run.smithi081.stdout:2904 write 0x355fd8 thru 0x360d60 (0xad89 bytes) 2024-09-18T00:32:24.732 INFO:teuthology.orchestra.run.smithi081.stdout:2905 read 0x6ca340b thru 0x6cab0d4 (0x7cca bytes) 2024-09-18T00:32:24.733 INFO:teuthology.orchestra.run.smithi081.stdout:2907 write 0x71b6219 thru 0x71b9921 (0x3709 bytes) 2024-09-18T00:32:24.737 INFO:teuthology.orchestra.run.smithi081.stdout:2908 punch from 0x6ae2c80 to 0x6af1e46, (0xf1c6 bytes) 2024-09-18T00:32:24.737 INFO:teuthology.orchestra.run.smithi081.stdout:2911 read 0x1cac4de thru 0x1cb801c (0xbb3f bytes) 2024-09-18T00:32:24.737 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.747 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:24.747 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:24.748 INFO:teuthology.orchestra.run.smithi081.stdout:2914 write 0xc4d2fe0 thru 0xc4dc477 (0x9498 bytes) 2024-09-18T00:32:24.750 INFO:teuthology.orchestra.run.smithi081.stdout:2918 write 0x3136f95 thru 0x3144df9 (0xde65 bytes) 2024-09-18T00:32:24.752 INFO:teuthology.orchestra.run.smithi081.stdout:2919 write 0x933b3ad thru 0x9345301 (0x9f55 bytes) 2024-09-18T00:32:24.753 INFO:teuthology.orchestra.run.smithi081.stdout:2921 write 0x13e47a0 thru 0x13f2762 (0xdfc3 bytes) 2024-09-18T00:32:24.755 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.755 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.756 INFO:teuthology.orchestra.run.smithi081.stdout:2925 write 0x9fd2ed9 thru 0x9fe0975 (0xda9d bytes) 2024-09-18T00:32:24.758 INFO:teuthology.orchestra.run.smithi081.stdout:2927 read 0x9ee3743 thru 0x9ef2e7e (0xf73c bytes) 2024-09-18T00:32:24.759 INFO:teuthology.orchestra.run.smithi081.stdout:2928 writesame 0x95f08c thru 0x962df8 data_size 0x25(0x3d6d bytes) 2024-09-18T00:32:24.761 INFO:teuthology.orchestra.run.smithi081.stdout:2929 writesame 0x1c3c4 thru 0x2abb1 data_size 0x7(0xe7ee bytes) 2024-09-18T00:32:24.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:24.767 INFO:teuthology.orchestra.run.smithi081.stdout:2930 punch from 0x8d4e8a4 to 0x8d59e7f, (0xb5db bytes) 2024-09-18T00:32:24.767 INFO:teuthology.orchestra.run.smithi081.stdout:2931 write 0xba019c3 thru 0xba071a8 (0x57e6 bytes) 2024-09-18T00:32:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:2934 writesame 0x25b1701 thru 0x25b2da7 data_size 0x1(0x16a7 bytes) 2024-09-18T00:32:24.779 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:24.779 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:24.783 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:24.783 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:24.786 INFO:teuthology.orchestra.run.smithi081.stdout:2935 trunc from 0xc4dc478 to 0x394dbe2 2024-09-18T00:32:24.789 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:24.802 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:24.803 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:24.800+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:24.803 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:24.805 INFO:teuthology.orchestra.run.smithi081.stdout:2937 trunc from 0x394dbe2 to 0x60729a3 2024-09-18T00:32:24.810 INFO:teuthology.orchestra.run.smithi081.stdout:2940 clone 23 order 25 su 2097152 sc 15 2024-09-18T00:32:24.820 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:24.836 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:24.853 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:24.853 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:24.905 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:24.904+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:24.932 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:24.932 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:24.932 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:24.932 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:24.932 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:24.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:25.004 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:25.003+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:32:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T00:32:25.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T00:32:25.047 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:25.047 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:25.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:25.047 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.244071374999997, 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:25.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:25.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.242140931999998, 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.057 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.242122592000001, 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:25.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:25.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.062 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.240531871000002, 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.063 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:25.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.067 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.240488638000002, 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:25.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.072 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.240290491000003, 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.073 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:25.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.077 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.240136098999997, 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:25.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:25.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.239922354000001, 2024-09-18T00:32:25.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:25.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.239723959000003, 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.088 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:25.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.239363111000003, 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.094 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:25.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.236082113000002, 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.099 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:25.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:25.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.236062938000003, 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.105 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:25.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.234203833999999, 2024-09-18T00:32:25.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.114 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.234178937000003, 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.119 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.234158432000001, 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.120 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:25.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:25.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:25.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:25.125 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.125 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.125 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.234139677999998, 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.126 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:25.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:25.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:25.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:25.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.132 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.132 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:25.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.232119396999998, 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.135 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:25.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:25.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:25.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:25.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.142 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.232100811000002, 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.143 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:25.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:25.148 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.231264897999999, 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.149 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.226089731999998, 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.158 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.159 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:25.160 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone22 from 0x60729a3 (overlap 0x1b2313d) to 0x2b6b52 2024-09-18T00:32:25.160 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-18T00:32:25.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:25.161 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:25.158+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:25.260 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:25.258+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:25.306 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:25.306 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:25.306 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:25.306 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:25.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:25.322 INFO:teuthology.orchestra.run.smithi081.stdout:2941 write 0xb157a1a thru 0xb163465 (0xba4c bytes) 2024-09-18T00:32:25.326 INFO:teuthology.orchestra.run.smithi081.stdout:2942 write 0x429fa7a thru 0x42a5159 (0x56e0 bytes) 2024-09-18T00:32:25.330 INFO:teuthology.orchestra.run.smithi081.stdout:2943 writesame 0x897b803 thru 0x897fd14 data_size 0x15(0x4512 bytes) 2024-09-18T00:32:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:25.337 INFO:teuthology.orchestra.run.smithi081.stdout:2946 trunc from 0xb163466 to 0xd6ad186 2024-09-18T00:32:25.342 INFO:teuthology.orchestra.run.smithi081.stdout:2948 write 0x883471d thru 0x8837cd8 (0x35bc bytes) 2024-09-18T00:32:25.344 INFO:teuthology.orchestra.run.smithi081.stdout:2951 write 0xa8294ac thru 0xa836664 (0xd1b9 bytes) 2024-09-18T00:32:25.349 INFO:teuthology.orchestra.run.smithi081.stdout:2952 write 0x6d694c1 thru 0x6d723c2 (0x8f02 bytes) 2024-09-18T00:32:25.351 INFO:teuthology.orchestra.run.smithi081.stdout:2953 write 0x6f942dd thru 0x6fa1f47 (0xdc6b bytes) 2024-09-18T00:32:25.355 INFO:teuthology.orchestra.run.smithi081.stdout:2954 punch from 0x5be37fe to 0x5becff0, (0x97f2 bytes) 2024-09-18T00:32:25.355 INFO:teuthology.orchestra.run.smithi081.stdout:2955 write 0x177995e thru 0x177ef87 (0x562a bytes) 2024-09-18T00:32:25.362 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:25.359+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:25.363 INFO:teuthology.orchestra.run.smithi081.stdout:2957 trunc from 0xd6ad186 to 0xa0ab2f7 2024-09-18T00:32:25.384 INFO:teuthology.orchestra.run.smithi081.stdout:2958 writesame 0x4690864 thru 0x469d6bc data_size 0x5(0xce59 bytes) 2024-09-18T00:32:25.392 INFO:teuthology.orchestra.run.smithi081.stdout:2959 writesame 0x85ffdc6 thru 0x8601136 data_size 0x3(0x1371 bytes) 2024-09-18T00:32:25.405 INFO:teuthology.orchestra.run.smithi081.stdout:2961 trunc from 0xa0ab2f7 to 0x149f151 2024-09-18T00:32:25.431 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:25.431 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:25.431 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:25.431 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:25.431 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:25.437 INFO:teuthology.orchestra.run.smithi081.stdout:2962 writesame 0x5a9ff20 thru 0x5aa620f data_size 0x8(0x62f0 bytes) 2024-09-18T00:32:25.438 INFO:teuthology.orchestra.run.smithi081.stdout:2963 read 0x2589bfb thru 0x25924b5 (0x88bb bytes) 2024-09-18T00:32:25.439 INFO:teuthology.orchestra.run.smithi081.stdout:2964 read 0x31e5f74 thru 0x31f03fe (0xa48b bytes) 2024-09-18T00:32:25.441 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:25.452 INFO:teuthology.orchestra.run.smithi081.stdout:2968 write 0xbecbeb3 thru 0xbecf1b2 (0x3300 bytes) 2024-09-18T00:32:25.454 INFO:teuthology.orchestra.run.smithi081.stdout:2969 writesame 0x78a8056 thru 0x78ad5c3 data_size 0x36(0x556e bytes) 2024-09-18T00:32:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:2970 trunc from 0xbecf1b3 to 0x555a6dd 2024-09-18T00:32:25.472 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:25.472 INFO:teuthology.orchestra.run.smithi081.stdout:2972 read 0x36d4922 thru 0x36e00cf (0xb7ae bytes) 2024-09-18T00:32:25.482 INFO:teuthology.orchestra.run.smithi081.stdout:2973 writesame 0x99f27e8 thru 0x9a01fc4 data_size 0xd(0xf7dd bytes) 2024-09-18T00:32:25.483 INFO:teuthology.orchestra.run.smithi081.stdout:2974 write 0x168b686 thru 0x168dad7 (0x2452 bytes) 2024-09-18T00:32:25.484 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:25.483+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:25.486 INFO:teuthology.orchestra.run.smithi081.stdout:2976 clone 24 order 22 su 2097152 sc 15 2024-09-18T00:32:25.547 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:25.547 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.187311688999998, 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.548 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.181963152000002, 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.552 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:25.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.178223426999999, 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:25.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:25.561 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.178199059000001, 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:25.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.566 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.178186478999997, 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.567 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.178176203, 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.572 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:25.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:25.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.166322018999999, 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.577 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.166301648999998, 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.582 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:25.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:25.586 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.164342011999999, 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:25.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.590 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.591 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.592 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:25.592 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.164332743000003, 2024-09-18T00:32:25.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:25.592 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:25.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.596 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.162319441999998, 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.597 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:25.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.162301280999998, 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.601 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.605 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.160003398000001, 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.606 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.608 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:25.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.159962948, 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.610 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.611 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:25.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.159867452, 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.615 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:25.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:25.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:25.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.158291726999998, 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.619 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:25.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:25.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.158271009000003, 2024-09-18T00:32:25.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.624 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:25.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:25.626 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.158247476, 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.628 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:25.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:25.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.158224877999999, 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:25.632 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:25.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:25.636 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.156269321000003, 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:25.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:25.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:25.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:25.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:25.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:25.642 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:25.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:25.644 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:25.641+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:25.744 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:25.743+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:25.787 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:25.787 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:25.787 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:25.787 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:25.796 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:25.880 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:25.879+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:25.939 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:25.940 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:25.940 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:25.940 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:25.940 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:25.946 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:25.944+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:25.948 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T00:32:26.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T00:32:26.047 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:26.046+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:26.100 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone23 from 0x9a01fc5 (overlap 0x149f151) to 0x62fb98 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1631 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 675840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.101 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.745872628000001, 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047626628999999997, 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1631 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353197+0000", 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353198+0000", 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2449999999999999e-06 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353201+0000", 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.399e-06 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353205+0000", 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5760000000000002e-06 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400685+0000", 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047480517999999999 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400769+0000", 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3473000000000005e-05 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400823+0000", 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4137e-05 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.105 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1632 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.745860563999997, 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047756706000000003, 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1632 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.106 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353209+0000", 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353210+0000", 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.514e-06 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353216+0000", 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3920000000000002e-06 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353219+0000", 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.315e-06 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400849+0000", 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047630231000000002 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400901+0000", 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1428999999999998e-05 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400965+0000", 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4543999999999997e-05 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1633 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.745846041999997, 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868945000000003, 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1633 2024-09-18T00:32:26.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354886+0000", 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001662979 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354890+0000", 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354899+0000", 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3510000000000008e-06 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354906+0000", 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5869999999999998e-06 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400994+0000", 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046087545000000001 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401038+0000", 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4535e-05 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401092+0000", 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3687999999999998e-05 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1682 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 47104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.743960844, 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047536968999999998, 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1682 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0100000000000001e-07 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355109+0000", 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8899999999999998e-07 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355112+0000", 2024-09-18T00:32:26.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8770000000000002e-06 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355115+0000", 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4030000000000001e-06 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402556+0000", 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047441715000000002 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402596+0000", 2024-09-18T00:32:26.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9635000000000003e-05 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402645+0000", 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9149e-05 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1683 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.743951385000003, 2024-09-18T00:32:26.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047646796999999998, 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1683 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356882+0000", 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001764334 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356890+0000", 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4759999999999998e-06 2024-09-18T00:32:26.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356901+0000", 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0533999999999999e-05 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356912+0000", 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1239e-05 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402670+0000", 2024-09-18T00:32:26.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045757985000000001 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402713+0000", 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3121000000000003e-05 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402764+0000", 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1107999999999999e-05 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.123 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1705 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 706560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.740009700000002, 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047596718000000003, 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1705 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360881+0000", 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001821802 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360885+0000", 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4809999999999998e-06 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360892+0000", 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360896+0000", 2024-09-18T00:32:26.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6140000000000002e-06 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406437+0000", 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045540046000000001 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406544+0000", 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107112 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406656+0000", 2024-09-18T00:32:26.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011232500000000001 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1715 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 993280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.738011657999998, 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047689281, 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1715 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:26.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361058+0000", 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361059+0000", 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.697e-06 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361065+0000", 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.507e-06 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361069+0000", 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.442e-06 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408546+0000", 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047476566999999997 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408638+0000", 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2218000000000004e-05 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408747+0000", 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108528 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.132 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1716 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 1021952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.737994037, 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047884890999999999, 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1716 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361077+0000", 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.823e-06 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361085+0000", 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5889999999999997e-06 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361089+0000", 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.651e-06 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408783+0000", 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047693194000000001 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408861+0000", 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8220000000000007e-05 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408960+0000", 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9049999999999995e-05 2024-09-18T00:32:26.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1754 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 20480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.737974047999998, 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048097325000000003, 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1754 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361097+0000", 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.714e-06 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361104+0000", 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8580000000000002e-06 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361117+0000", 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3118e-05 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408998+0000", 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047881263 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409088+0000", 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9918000000000002e-05 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409192+0000", 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104079 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1755 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.737945228999997, 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048258826999999997, 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.141 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1755 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.32e-07 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361126+0000", 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1059999999999998e-06 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361132+0000", 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0299999999999999e-06 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361137+0000", 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409215+0000", 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048078567000000003 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409294+0000", 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8467999999999995e-05 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409383+0000", 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8840999999999999e-05 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.145 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1756 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 77824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.737926569000003, 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048360829000000001, 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1756 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361143+0000", 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361154+0000", 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1336e-05 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361161+0000", 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2629999999999997e-06 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361171+0000", 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3049999999999998e-06 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409408+0000", 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048237447000000003 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409451+0000", 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3284000000000001e-05 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409503+0000", 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1833000000000003e-05 2024-09-18T00:32:26.149 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1757 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.737891138999998, 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048438623, 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.150 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1757 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362883+0000", 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017047620000000001 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362887+0000", 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1690000000000002e-06 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362897+0000", 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0362e-05 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362905+0000", 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6369999999999999e-06 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409527+0000", 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046622334000000001 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409566+0000", 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9427e-05 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409616+0000", 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9932000000000002e-05 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1764 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 307200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.735990420999997, 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047564585999999999, 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1764 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363081+0000", 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.869e-06 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363087+0000", 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.387e-06 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363092+0000", 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410478+0000", 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047385746999999999 2024-09-18T00:32:26.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410535+0000", 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7154999999999997e-05 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410643+0000", 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108311 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.158 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1765 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.735970492, 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047660415999999997, 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1765 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363099+0000", 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363102+0000", 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.898e-06 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363108+0000", 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363118+0000", 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9969999999999993e-06 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410660+0000", 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047542415999999997 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410703+0000", 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2231000000000003e-05 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410759+0000", 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6271999999999999e-05 2024-09-18T00:32:26.162 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1766 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 364544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.735945770000001, 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868621, 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.163 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1766 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363124+0000", 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363125+0000", 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.48e-06 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363129+0000", 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7579999999999998e-06 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363131+0000", 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5320000000000001e-06 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410797+0000", 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047665893000000001 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410892+0000", 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4406000000000004e-05 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410992+0000", 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100191 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1767 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 393216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.735934440999998, 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047993455999999997, 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1767 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363135+0000", 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0599999999999999e-07 2024-09-18T00:32:26.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363139+0000", 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5249999999999999e-06 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363143+0000", 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3550000000000001e-06 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363145+0000", 2024-09-18T00:32:26.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411022+0000", 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047877292000000002 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411073+0000", 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0528999999999997e-05 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411128+0000", 2024-09-18T00:32:26.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4923000000000003e-05 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1768 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.735920454999999, 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048176798, 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1768 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:26.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364882+0000", 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733917 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364892+0000", 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.577e-06 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364911+0000", 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8868999999999998e-05 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364917+0000", 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8640000000000001e-06 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411156+0000", 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046238915999999998 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411220+0000", 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4751000000000004e-05 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411325+0000", 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104904 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1775 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 622592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:26.176 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.734026833000001, 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047673465999999998, 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1775 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:26.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365044+0000", 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1200000000000001e-06 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365047+0000", 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.269e-06 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365049+0000", 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5720000000000001e-06 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412581+0000", 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047531363 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412636+0000", 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4969999999999997e-05 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412716+0000", 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9861e-05 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.180 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1776 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.734016451999999, 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047805461, 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1776 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.181 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365053+0000", 2024-09-18T00:32:26.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365054+0000", 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0189999999999999e-06 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365057+0000", 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0299999999999998e-06 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365059+0000", 2024-09-18T00:32:26.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4619999999999999e-06 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412745+0000", 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047685412000000003 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412795+0000", 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9904000000000002e-05 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412858+0000", 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3406999999999998e-05 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1777 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 33.734006782000002, 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047940417999999999, 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:26.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1777 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:26.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366880+0000", 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018183279999999999 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366884+0000", 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.002e-06 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366896+0000", 2024-09-18T00:32:26.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1119e-05 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366905+0000", 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4930000000000004e-06 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412893+0000", 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045988345999999999 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:26.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412947+0000", 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413003+0000", 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5770999999999998e-05 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:26.189 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:26.191 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-18T00:32:26.191 INFO:teuthology.orchestra.run.smithi081.stdout:2977 punch from 0x39a4ed3 to 0x39ae138, (0x9265 bytes) 2024-09-18T00:32:26.191 INFO:teuthology.orchestra.run.smithi081.stdout:2978 write 0x56484e0 thru 0x564be10 (0x3931 bytes) 2024-09-18T00:32:26.191 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:26.189+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:26.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:26.198 INFO:teuthology.orchestra.run.smithi081.stdout:2979 writesame 0xda705d2 thru 0xda7799e data_size 0xb(0x73cd bytes) 2024-09-18T00:32:26.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.199 INFO:teuthology.orchestra.run.smithi081.stdout:2983 writesame 0xa6d5dc1 thru 0xa6db576 data_size 0x2(0x57b6 bytes) 2024-09-18T00:32:26.207 INFO:teuthology.orchestra.run.smithi081.stdout:2984 write 0x6a29cb8 thru 0x6a35f27 (0xc270 bytes) 2024-09-18T00:32:26.212 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.214 INFO:teuthology.orchestra.run.smithi081.stdout:2988 trunc from 0xda7799f to 0xb3b9cf2 2024-09-18T00:32:26.223 INFO:teuthology.orchestra.run.smithi081.stdout:2989 read 0x78d0640 thru 0x78d8ca7 (0x8668 bytes) 2024-09-18T00:32:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:2990 writesame 0xe768312 thru 0xe76fc06 data_size 0xb(0x78f5 bytes) 2024-09-18T00:32:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:2991 read 0x1e95def thru 0x1e9cd21 (0x6f33 bytes) 2024-09-18T00:32:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:2992 read 0xd922140 thru 0xd92fcf9 (0xdbba bytes) 2024-09-18T00:32:26.235 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.235 INFO:teuthology.orchestra.run.smithi081.stdout:2994 writesame 0x9ba9f9b thru 0x9bb2710 data_size 0x7(0x8776 bytes) 2024-09-18T00:32:26.241 INFO:teuthology.orchestra.run.smithi081.stdout:2995 writesame 0x70babd5 thru 0x70bf76e data_size 0x1(0x4b9a bytes) 2024-09-18T00:32:26.257 INFO:teuthology.orchestra.run.smithi081.stdout:2996 writesame 0x32f91e3 thru 0x3308643 data_size 0x1(0xf461 bytes) 2024-09-18T00:32:26.291 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:26.289+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:26.301 INFO:teuthology.orchestra.run.smithi081.stdout:2998 write 0x27ab71a thru 0x27ba757 (0xf03e bytes) 2024-09-18T00:32:26.310 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.317 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:26.317 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:26.317 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:26.318 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:26.323 INFO:teuthology.orchestra.run.smithi081.stdout:3000 trunc from 0xe76fc07 to 0x338e89c 2024-09-18T00:32:26.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:26.350 INFO:teuthology.orchestra.run.smithi081.stdout:3001 write 0x588dd4a thru 0x589674d (0x8a04 bytes) 2024-09-18T00:32:26.353 INFO:teuthology.orchestra.run.smithi081.stdout:3003 write 0x2574243 thru 0x2577285 (0x3043 bytes) 2024-09-18T00:32:26.363 INFO:teuthology.orchestra.run.smithi081.stdout:3007 write 0x5913f54 thru 0x591c4cf (0x857c bytes) 2024-09-18T00:32:26.366 INFO:teuthology.orchestra.run.smithi081.stdout:3008 trunc from 0x591c4d0 to 0x40c94a9 2024-09-18T00:32:26.377 INFO:teuthology.orchestra.run.smithi081.stdout:3009 punch from 0x240dbd9 to 0x2410ddb, (0x3202 bytes) 2024-09-18T00:32:26.377 INFO:teuthology.orchestra.run.smithi081.stdout:3010 punch from 0x254ba46 to 0x255ae42, (0xf3fc bytes) 2024-09-18T00:32:26.377 INFO:teuthology.orchestra.run.smithi081.stdout:3011 read 0x3022ade thru 0x30239cd (0xef0 bytes) 2024-09-18T00:32:26.391 INFO:teuthology.orchestra.run.smithi081.stdout:3012 write 0xadae188 thru 0xadb7c8f (0x9b08 bytes) 2024-09-18T00:32:26.392 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:26.389+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:26.394 INFO:teuthology.orchestra.run.smithi081.stdout:3013 punch from 0x6c5e1e3 to 0x6c5ea67, (0x884 bytes) 2024-09-18T00:32:26.403 INFO:teuthology.orchestra.run.smithi081.stdout:3014 write 0xdbcc517 thru 0xdbd705b (0xab45 bytes) 2024-09-18T00:32:26.406 INFO:teuthology.orchestra.run.smithi081.stdout:3015 read 0x32e1de3 thru 0x32f0fa0 (0xf1be bytes) 2024-09-18T00:32:26.406 INFO:teuthology.orchestra.run.smithi081.stdout:3017 writesame 0x7d40d55 thru 0x7d4d66a data_size 0x7(0xc916 bytes) 2024-09-18T00:32:26.413 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.414 INFO:teuthology.orchestra.run.smithi081.stdout:3022 write 0x42d5aac thru 0x42e4368 (0xe8bd bytes) 2024-09-18T00:32:26.417 INFO:teuthology.orchestra.run.smithi081.stdout:3024 writesame 0x7b13d53 thru 0x7b15cc5 data_size 0x1(0x1f73 bytes) 2024-09-18T00:32:26.424 INFO:teuthology.orchestra.run.smithi081.stdout:3025 write 0x4e5d1a9 thru 0x4e69de9 (0xcc41 bytes) 2024-09-18T00:32:26.428 INFO:teuthology.orchestra.run.smithi081.stdout:3026 read 0x37a637 thru 0x3821ea (0x7bb4 bytes) 2024-09-18T00:32:26.429 INFO:teuthology.orchestra.run.smithi081.stdout:3027 write 0xd847eb9 thru 0xd8538bd (0xba05 bytes) 2024-09-18T00:32:26.432 INFO:teuthology.orchestra.run.smithi081.stdout:3028 writesame 0x1623954 thru 0x1633386 data_size 0xd(0xfa33 bytes) 2024-09-18T00:32:26.435 INFO:teuthology.orchestra.run.smithi081.stdout:3031 writesame 0xb1bff9d thru 0xb1c0735 data_size 0x1(0x799 bytes) 2024-09-18T00:32:26.439 INFO:teuthology.orchestra.run.smithi081.stdout:3032 write 0x640e01c thru 0x6410abb (0x2aa0 bytes) 2024-09-18T00:32:26.443 INFO:teuthology.orchestra.run.smithi081.stdout:3034 write 0x1b76423 thru 0x1b844da (0xe0b8 bytes) 2024-09-18T00:32:26.445 INFO:teuthology.orchestra.run.smithi081.stdout:3035 write 0x40b685a thru 0x40b6c72 (0x419 bytes) 2024-09-18T00:32:26.448 INFO:teuthology.orchestra.run.smithi081.stdout:3036 read 0x70c0eeb thru 0x70c9ad8 (0x8bee bytes) 2024-09-18T00:32:26.448 INFO:teuthology.orchestra.run.smithi081.stdout:3038 writesame 0x2c31711 thru 0x2c36755 data_size 0x1(0x5045 bytes) 2024-09-18T00:32:26.460 INFO:teuthology.orchestra.run.smithi081.stdout:3039 read 0x14071f0 thru 0x140b441 (0x4252 bytes) 2024-09-18T00:32:26.461 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:26.461 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:26.461 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:26.461 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:26.461 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:26.462 INFO:teuthology.orchestra.run.smithi081.stdout:3040 read 0x6ef6a22 thru 0x6f01240 (0xa81f bytes) 2024-09-18T00:32:26.462 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.462 INFO:teuthology.orchestra.run.smithi081.stdout:3043 write 0x7759883 thru 0x7768b59 (0xf2d7 bytes) 2024-09-18T00:32:26.465 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.465 INFO:teuthology.orchestra.run.smithi081.stdout:3045 read 0x8395575 thru 0x839e04c (0x8ad8 bytes) 2024-09-18T00:32:26.465 INFO:teuthology.orchestra.run.smithi081.stdout:3046 read 0x2b8dce4 thru 0x2b98c68 (0xaf85 bytes) 2024-09-18T00:32:26.465 INFO:teuthology.orchestra.run.smithi081.stdout:3047 read 0x93edfab thru 0x93fc3c7 (0xe41d bytes) 2024-09-18T00:32:26.466 INFO:teuthology.orchestra.run.smithi081.stdout:3048 read 0x8d5f1d2 thru 0x8d65878 (0x66a7 bytes) 2024-09-18T00:32:26.466 INFO:teuthology.orchestra.run.smithi081.stdout:3049 punch from 0x42d0448 to 0x42d383c, (0x33f4 bytes) 2024-09-18T00:32:26.466 INFO:teuthology.orchestra.run.smithi081.stdout:3050 write 0x722143e thru 0x722a3e4 (0x8fa7 bytes) 2024-09-18T00:32:26.469 INFO:teuthology.orchestra.run.smithi081.stdout:3052 punch from 0x491866e to 0x4921b4d, (0x94df bytes) 2024-09-18T00:32:26.470 INFO:teuthology.orchestra.run.smithi081.stdout:3055 punch from 0xc0c882a to 0xc0cbcc8, (0x349e bytes) 2024-09-18T00:32:26.470 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.470 INFO:teuthology.orchestra.run.smithi081.stdout:3057 write 0xb5c2b55 thru 0xb5c650e (0x39ba bytes) 2024-09-18T00:32:26.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:26.473 INFO:teuthology.orchestra.run.smithi081.stdout:3059 trunc from 0xdbd705c to 0xe7b1a00 2024-09-18T00:32:26.486 INFO:teuthology.orchestra.run.smithi081.stdout:3060 trunc from 0xe7b1a00 to 0x7dd8f5f 2024-09-18T00:32:26.493 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:26.491+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:26.502 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.511 INFO:teuthology.orchestra.run.smithi081.stdout:3062 write 0xbac97be thru 0xbad2ef0 (0x9733 bytes) 2024-09-18T00:32:26.515 INFO:teuthology.orchestra.run.smithi081.stdout:3063 read 0xf0a686 thru 0xf15abe (0xb439 bytes) 2024-09-18T00:32:26.515 INFO:teuthology.orchestra.run.smithi081.stdout:3064 read 0x21ec0aa thru 0x21fb7e2 (0xf739 bytes) 2024-09-18T00:32:26.516 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.516 INFO:teuthology.orchestra.run.smithi081.stdout:3067 punch from 0x201a282 to 0x2023534, (0x92b2 bytes) 2024-09-18T00:32:26.516 INFO:teuthology.orchestra.run.smithi081.stdout:3068 writesame 0x345d100 thru 0x345d8dd data_size 0x13(0x7de bytes) 2024-09-18T00:32:26.517 INFO:teuthology.orchestra.run.smithi081.stdout:3070 write 0x171b5c3 thru 0x171e3dc (0x2e1a bytes) 2024-09-18T00:32:26.518 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.518 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.523 INFO:teuthology.orchestra.run.smithi081.stdout:3073 trunc from 0xbad2ef1 to 0x7e63ab8 2024-09-18T00:32:26.534 INFO:teuthology.orchestra.run.smithi081.stdout:3074 punch from 0x7665260 to 0x7668187, (0x2f27 bytes) 2024-09-18T00:32:26.544 INFO:teuthology.orchestra.run.smithi081.stdout:3075 writesame 0xbc069bf thru 0xbc0eea8 data_size 0x6(0x84ea bytes) 2024-09-18T00:32:26.544 INFO:teuthology.orchestra.run.smithi081.stdout:3076 read 0x4821ba3 thru 0x482c4a6 (0xa904 bytes) 2024-09-18T00:32:26.544 INFO:teuthology.orchestra.run.smithi081.stdout:3078 writesame 0x27c560a thru 0x27d2f41 data_size 0x54(0xd938 bytes) 2024-09-18T00:32:26.546 INFO:teuthology.orchestra.run.smithi081.stdout:3079 write 0x94f2d6c thru 0x94f60e3 (0x3378 bytes) 2024-09-18T00:32:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.549 INFO:teuthology.orchestra.run.smithi081.stdout:3082 punch from 0x77127bf to 0x7717b48, (0x5389 bytes) 2024-09-18T00:32:26.550 INFO:teuthology.orchestra.run.smithi081.stdout:3083 punch from 0x4269c74 to 0x426a3d1, (0x75d bytes) 2024-09-18T00:32:26.550 INFO:teuthology.orchestra.run.smithi081.stdout:3084 writesame 0x903ad4f thru 0x90405ed data_size 0x7(0x589f bytes) 2024-09-18T00:32:26.554 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:26.554 INFO:teuthology.orchestra.run.smithi081.stdout:3087 write 0x164efc8 thru 0x165e0dc (0xf115 bytes) 2024-09-18T00:32:26.562 INFO:teuthology.orchestra.run.smithi081.stdout:3088 write 0xc193ae8 thru 0xc19c019 (0x8532 bytes) 2024-09-18T00:32:26.564 INFO:teuthology.orchestra.run.smithi081.stdout:3090 read 0xa8e42ff thru 0xa8eacf9 (0x69fb bytes) 2024-09-18T00:32:26.564 INFO:teuthology.orchestra.run.smithi081.stdout:3091 read 0x49302ab thru 0x4936af0 (0x6846 bytes) 2024-09-18T00:32:26.566 INFO:teuthology.orchestra.run.smithi081.stdout:3093 trunc from 0xc19c01a to 0xdf4a431 2024-09-18T00:32:26.571 INFO:teuthology.orchestra.run.smithi081.stdout:3094 read 0x28a244b thru 0x28ae555 (0xc10b bytes) 2024-09-18T00:32:26.571 INFO:teuthology.orchestra.run.smithi081.stdout:3095 writesame 0x994a7c3 thru 0x994ea8c data_size 0x2(0x42ca bytes) 2024-09-18T00:32:26.579 INFO:teuthology.orchestra.run.smithi081.stdout:3096 writesame 0xdebaead thru 0xdebd24c data_size 0x10(0x23a0 bytes) 2024-09-18T00:32:26.581 INFO:teuthology.orchestra.run.smithi081.stdout:3097 clone 25 order 21 su 32768 sc 4 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5129 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623412019, 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028611574000000001, 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5129 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964567+0000", 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0899999999999997e-07 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964568+0000", 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8050000000000001e-06 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964577+0000", 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3149999999999992e-06 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964581+0000", 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4789999999999998e-06 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993004+0000", 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028422612 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993083+0000", 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9367000000000001e-05 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993178+0000", 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4686999999999997e-05 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5130 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623391691000002, 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029079462, 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5130 2024-09-18T00:32:26.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0100000000000001e-07 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964593+0000", 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0809999999999999e-06 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964599+0000", 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9660000000000001e-06 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964603+0000", 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3340000000000003e-06 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993209+0000", 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028605815 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993577+0000", 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036788599999999999 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993666+0000", 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9079000000000006e-05 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5168 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 26624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623369533999998, 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02923388, 2024-09-18T00:32:26.599 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5168 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964611+0000", 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6390000000000001e-06 2024-09-18T00:32:26.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964616+0000", 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1880000000000001e-06 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964620+0000", 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993694+0000", 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029073485 2024-09-18T00:32:26.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993763+0000", 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9064000000000001e-05 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993843+0000", 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9919999999999994e-05 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5169 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623353010000002, 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029406055, 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5169 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964626+0000", 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:26.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964627+0000", 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6649999999999999e-06 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964633+0000", 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964637+0000", 2024-09-18T00:32:26.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.189e-06 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993870+0000", 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029233424000000001 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993951+0000", 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1051999999999996e-05 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994031+0000", 2024-09-18T00:32:26.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0019999999999996e-05 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5170 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 83968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623336614999999, 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029576037999999999, 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5170 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:26.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964644+0000", 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5540000000000001e-06 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964650+0000", 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0950000000000001e-06 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964654+0000", 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3250000000000001e-06 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994058+0000", 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029403655000000001 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994133+0000", 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4974000000000004e-05 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994218+0000", 2024-09-18T00:32:26.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5144999999999999e-05 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5171 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623317163000003, 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030497487, 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5171 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964662+0000", 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964663+0000", 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.722e-06 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964672+0000", 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7320000000000004e-06 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964677+0000", 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.527e-06 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994247+0000", 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029570603000000001 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995061+0000", 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00081419399999999996 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995159+0000", 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7380999999999995e-05 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5172 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623296400999998, 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030717230000000002, 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5172 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964691+0000", 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6149999999999997e-06 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964697+0000", 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964705+0000", 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0320000000000003e-06 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995209+0000", 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030504452000000001 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995301+0000", 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1367999999999997e-05 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995399+0000", 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8340999999999999e-05 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5173 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623267546999998, 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030867024, 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5173 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0500000000000004e-07 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964713+0000", 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.84e-06 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964719+0000", 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4600000000000002e-06 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964723+0000", 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995429+0000", 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030706563999999999 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995500+0000", 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0500999999999995e-05 2024-09-18T00:32:26.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995578+0000", 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8035999999999996e-05 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5174 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623250702999997, 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031034297999999998, 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5174 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964730+0000", 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.655e-06 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964735+0000", 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3940000000000004e-06 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964744+0000", 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995603+0000", 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030859780999999999 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995676+0000", 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2704000000000001e-05 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995762+0000", 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5841999999999996e-05 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5175 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:26.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623229162000001, 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031208080999999999, 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5175 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:26.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964750+0000", 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964751+0000", 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.829e-06 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964757+0000", 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3789999999999997e-06 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964761+0000", 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1520000000000002e-06 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995789+0000", 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031028525000000001 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995862+0000", 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2515999999999995e-05 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995957+0000", 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5340000000000005e-05 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5176 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 256000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623212172999999, 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031341039000000001, 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5176 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964767+0000", 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964768+0000", 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6610000000000001e-06 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964774+0000", 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3850000000000001e-06 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964778+0000", 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995985+0000", 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031206289000000002 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996058+0000", 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2974999999999998e-05 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996107+0000", 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9639999999999999e-05 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5177 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 284672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623195004999999, 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031522255999999998, 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5177 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:26.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964784+0000", 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9200000000000002e-07 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964785+0000", 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6869999999999999e-06 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964797+0000", 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1282e-05 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964801+0000", 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5510000000000001e-06 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996136+0000", 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031334870000000001 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996211+0000", 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4475999999999996e-05 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996306+0000", 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5098000000000003e-05 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5178 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 313344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623171577999997, 2024-09-18T00:32:26.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031735948, 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5178 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964809+0000", 2024-09-18T00:32:26.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7630000000000001e-06 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964819+0000", 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0224000000000001e-05 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964824+0000", 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4139999999999996e-06 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996356+0000", 2024-09-18T00:32:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031532646999999997 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996446+0000", 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9993000000000004e-05 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996543+0000", 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6576000000000005e-05 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5179 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623148739999998, 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031953505, 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5179 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:26.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964837+0000", 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964843+0000", 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.336e-06 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964848+0000", 2024-09-18T00:32:26.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4440000000000001e-06 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996593+0000", 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031745821 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996680+0000", 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6953000000000006e-05 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996783+0000", 2024-09-18T00:32:26.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010280000000000001 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5180 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 370688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623124425, 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032134442999999999, 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5180 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964856+0000", 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964862+0000", 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.519e-06 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964866+0000", 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996812+0000", 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031946039000000002 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996899+0000", 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7064999999999994e-05 2024-09-18T00:32:26.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996988+0000", 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9370999999999995e-05 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5181 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 399360~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623102785, 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.03234393, 2024-09-18T00:32:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5181 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964878+0000", 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.844e-06 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964883+0000", 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1100000000000002e-06 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964887+0000", 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9169999999999999e-06 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997032+0000", 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032145646 2024-09-18T00:32:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997116+0000", 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3858999999999998e-05 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997220+0000", 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010323399999999999 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5182 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623086729999997, 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032589419000000001, 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5182 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964894+0000", 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6700000000000001e-06 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964899+0000", 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1080000000000001e-06 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964903+0000", 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8210000000000003e-06 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997297+0000", 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032394065 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997380+0000", 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3226000000000006e-05 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997481+0000", 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101048 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5183 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623064218000003, 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032807066000000003, 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5183 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964921+0000", 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964926+0000", 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964934+0000", 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6809999999999998e-06 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997526+0000", 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032591805000000001 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997617+0000", 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1439000000000003e-05 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997721+0000", 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0001039 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5184 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623038428000001, 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033026119, 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5184 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964942+0000", 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.846e-06 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964948+0000", 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5489999999999997e-06 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964952+0000", 2024-09-18T00:32:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1060000000000002e-06 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997766+0000", 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032814589999999998 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997863+0000", 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6146999999999999e-05 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997966+0000", 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103454 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5185 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 514048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.623021772000001, 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033245331000000003, 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5185 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9400000000000001e-07 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964958+0000", 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6160000000000001e-06 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964969+0000", 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-18T00:32:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964974+0000", 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2180000000000001e-06 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998013+0000", 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033038901000000002 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998112+0000", 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9028000000000001e-05 2024-09-18T00:32:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998202+0000", 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0288e-05 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:26.681 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:26.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:26.683 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:26.681+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:26.783 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:26.781+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:26.827 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:26.827 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:26.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:26.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:26.884 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:26.883+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:26.982 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:26.982 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:26.984 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:26.982+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:26.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:26.998 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:27.015 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:27.015 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:27.031 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:27.032 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T00:32:27.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:32:27.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T00:32:27.063 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:27.085 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:27.086 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:27.086 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:27.083+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:27.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:27.126 INFO:teuthology.orchestra.run.smithi081.stdout:flattening image image_client.0-clone24 2024-09-18T00:32:27.147 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:27.147 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:27.151 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:27.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:27.186 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:27.185+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:27.285 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:27.285 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:27.287 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:27.286+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:27.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:27.324 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-18T00:32:27.337 INFO:teuthology.orchestra.run.smithi081.stdout:3098 trunc from 0xdf4a431 to 0xde18774 2024-09-18T00:32:27.358 INFO:teuthology.orchestra.run.smithi081.stdout:3099 write 0x5d251bd thru 0x5d2caa8 (0x78ec bytes) 2024-09-18T00:32:27.370 INFO:teuthology.orchestra.run.smithi081.stdout:3100 trunc from 0xde18774 to 0xc02b0d7 2024-09-18T00:32:27.388 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:27.387+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:27.396 INFO:teuthology.orchestra.run.smithi081.stdout:3102 write 0x5981bae thru 0x598cce4 (0xb137 bytes) 2024-09-18T00:32:27.397 INFO:teuthology.orchestra.run.smithi081.stdout:3103 write 0x4678907 thru 0x467b496 (0x2b90 bytes) 2024-09-18T00:32:27.406 INFO:teuthology.orchestra.run.smithi081.stdout:3104 writesame 0xbaacd16 thru 0xbab296a data_size 0x1(0x5c55 bytes) 2024-09-18T00:32:27.421 INFO:teuthology.orchestra.run.smithi081.stdout:3106 read 0x3e11442 thru 0x3e1b84c (0xa40b bytes) 2024-09-18T00:32:27.428 INFO:teuthology.orchestra.run.smithi081.stdout:3108 write 0xcd816e1 thru 0xcd90b31 (0xf451 bytes) 2024-09-18T00:32:27.444 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:27.445 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:27.448 INFO:teuthology.orchestra.run.smithi081.stdout:3110 trunc from 0xcd90b32 to 0x3a1395b 2024-09-18T00:32:27.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:27.486 INFO:teuthology.orchestra.run.smithi081.stdout:3112 writesame 0x90af1a1 thru 0x90bc757 data_size 0x3(0xd5b7 bytes) 2024-09-18T00:32:27.486 INFO:teuthology.orchestra.run.smithi081.stdout:3113 flatten 2024-09-18T00:32:27.488 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:27.487+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:27.589 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:27.588+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:27.605 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:27.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:27.690 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:27.688+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:27.718 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:27.718 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:27.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:27.792 INFO:teuthology.orchestra.run.smithi081.stdout:3114 write 0x1eac257 thru 0x1eb7b66 (0xb910 bytes) 2024-09-18T00:32:27.793 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:27.791+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:27.796 INFO:teuthology.orchestra.run.smithi081.stdout:3115 write 0x4ce2ede thru 0x4ceef7f (0xc0a2 bytes) 2024-09-18T00:32:27.809 INFO:teuthology.orchestra.run.smithi081.stdout:3118 trunc from 0x90bc758 to 0x3eff3a0 2024-09-18T00:32:27.832 INFO:teuthology.orchestra.run.smithi081.stdout:3119 write 0x560ab57 thru 0x560e1c2 (0x366c bytes) 2024-09-18T00:32:27.838 INFO:teuthology.orchestra.run.smithi081.stdout:3120 trunc from 0x560e1c3 to 0x912faf6 2024-09-18T00:32:27.844 INFO:teuthology.orchestra.run.smithi081.stdout:3122 writesame 0x8594c4a thru 0x85a3c86 data_size 0x1(0xf03d bytes) 2024-09-18T00:32:27.883 INFO:teuthology.orchestra.run.smithi081.stdout:3124 writesame 0x117955b thru 0x117c835 data_size 0x1(0x32db bytes) 2024-09-18T00:32:27.884 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:27.884 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:27.892 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:27.890+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:27.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:27.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:27.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:27.902 INFO:teuthology.orchestra.run.smithi081.stdout:3130 write 0xc59310b thru 0xc59a87f (0x7775 bytes) 2024-09-18T00:32:27.906 INFO:teuthology.orchestra.run.smithi081.stdout:3131 read 0xb5adf thru 0xc0557 (0xaa79 bytes) 2024-09-18T00:32:27.914 INFO:teuthology.orchestra.run.smithi081.stdout:3132 write 0xd72ff24 thru 0xd73808a (0x8167 bytes) 2024-09-18T00:32:27.919 INFO:teuthology.orchestra.run.smithi081.stdout:3133 read 0xbd80d82 thru 0xbd8ee5b (0xe0da bytes) 2024-09-18T00:32:27.931 INFO:teuthology.orchestra.run.smithi081.stdout:3134 trunc from 0xd73808b to 0x3af4a18 2024-09-18T00:32:27.957 INFO:teuthology.orchestra.run.smithi081.stdout:3135 write 0x9da147c thru 0x9dabbaf (0xa734 bytes) 2024-09-18T00:32:27.961 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:27.971 INFO:teuthology.orchestra.run.smithi081.stdout:3137 write 0xe30bd16 thru 0xe319a98 (0xdd83 bytes) 2024-09-18T00:32:27.975 INFO:teuthology.orchestra.run.smithi081.stdout:3138 writesame 0x9c012ae thru 0x9c0d31f data_size 0x17(0xc072 bytes) 2024-09-18T00:32:27.977 INFO:teuthology.orchestra.run.smithi081.stdout:3139 clone 26 order 20 su 65536 sc 2 2024-09-18T00:32:27.993 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:27.991+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:28.040 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T00:32:28.040 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:32:28.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T00:32:28.093 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:28.092+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:28.135 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.135 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:28.194 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:28.192+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:28.252 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-18T00:32:28.289 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.289 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.294 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:28.293+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:28.298 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:28.396 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:28.394+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:28.442 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.442 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:28.526 INFO:teuthology.orchestra.run.smithi081.stdout:3140 read 0xbbd0ce9 thru 0xbbde3db (0xd6f3 bytes) 2024-09-18T00:32:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:3142 read 0xbc41c49 thru 0xbc43e0a (0x21c2 bytes) 2024-09-18T00:32:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:3143 write 0x7fe295f thru 0x7fe9d1c (0x73be bytes) 2024-09-18T00:32:28.534 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:28.533+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:3144 punch from 0x1f5d247 to 0x1f69ead, (0xcc66 bytes) 2024-09-18T00:32:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:3146 write 0x56639af thru 0x566f187 (0xb7d9 bytes) 2024-09-18T00:32:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:3147 writesame 0x3151768 thru 0x315395a data_size 0x1(0x21f3 bytes) 2024-09-18T00:32:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:3148 write 0xc9e6f0f thru 0xc9ee3fd (0x74ef bytes) 2024-09-18T00:32:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:3149 writesame 0x33bdd85 thru 0x33c99a8 data_size 0x2(0xbc24 bytes) 2024-09-18T00:32:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:3151 punch from 0x38cb040 to 0x38cd37e, (0x233e bytes) 2024-09-18T00:32:28.583 INFO:teuthology.orchestra.run.smithi081.stdout:3152 trunc from 0xe319a99 to 0x94939f 2024-09-18T00:32:28.598 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:28.596+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:28.601 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:28.601 INFO:teuthology.orchestra.run.smithi081.stdout:3154 read 0x3ea409 thru 0x3f6f6b (0xcb63 bytes) 2024-09-18T00:32:28.604 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.604 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:28.619 INFO:teuthology.orchestra.run.smithi081.stdout:3156 write 0xa4b31a4 thru 0xa4c0a10 (0xd86d bytes) 2024-09-18T00:32:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:3158 write 0x155ab00 thru 0x155dd15 (0x3216 bytes) 2024-09-18T00:32:28.627 INFO:teuthology.orchestra.run.smithi081.stdout:3159 write 0x38e3e96 thru 0x38e8769 (0x48d4 bytes) 2024-09-18T00:32:28.630 INFO:teuthology.orchestra.run.smithi081.stdout:3160 read 0x3acf467 thru 0x3adc750 (0xd2ea bytes) 2024-09-18T00:32:28.635 INFO:teuthology.orchestra.run.smithi081.stdout:3162 trunc from 0xa4c0a11 to 0xe242ec8 2024-09-18T00:32:28.640 INFO:teuthology.orchestra.run.smithi081.stdout:3163 writesame 0x2eb9b4 thru 0x2f0049 data_size 0x1a(0x4696 bytes) 2024-09-18T00:32:28.647 INFO:teuthology.orchestra.run.smithi081.stdout:3165 read 0x2ac83f8 thru 0x2ad0049 (0x7c52 bytes) 2024-09-18T00:32:28.647 INFO:teuthology.orchestra.run.smithi081.stdout:3166 trunc from 0xe242ec8 to 0xdcb93ce 2024-09-18T00:32:28.653 INFO:teuthology.orchestra.run.smithi081.stdout:3167 punch from 0xb6f34d9 to 0xb6fc820, (0x9347 bytes) 2024-09-18T00:32:28.653 INFO:teuthology.orchestra.run.smithi081.stdout:3168 write 0x7bdaaae thru 0x7be9fd8 (0xf52b bytes) 2024-09-18T00:32:28.657 INFO:teuthology.orchestra.run.smithi081.stdout:3169 read 0xa887a13 thru 0xa894aca (0xd0b8 bytes) 2024-09-18T00:32:28.658 INFO:teuthology.orchestra.run.smithi081.stdout:3170 read 0x2ab15cd thru 0x2ab9321 (0x7d55 bytes) 2024-09-18T00:32:28.673 INFO:teuthology.orchestra.run.smithi081.stdout:3173 trunc from 0xdcb93ce to 0xc5cd96 2024-09-18T00:32:28.686 INFO:teuthology.orchestra.run.smithi081.stdout:3174 read 0x9a83a4 thru 0x9abcdd (0x393a bytes) 2024-09-18T00:32:28.686 INFO:teuthology.orchestra.run.smithi081.stdout:3175 read 0x9791ea thru 0x9848c3 (0xb6da bytes) 2024-09-18T00:32:28.695 INFO:teuthology.orchestra.run.smithi081.stdout:3176 trunc from 0xc5cd96 to 0x7e256c3 2024-09-18T00:32:28.698 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:28.697+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:3178 trunc from 0x7e256c3 to 0x4776a16 2024-09-18T00:32:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:3179 trunc from 0x4776a16 to 0x6ce7c1f 2024-09-18T00:32:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:3180 read 0x69abc8 thru 0x6a5209 (0xa642 bytes) 2024-09-18T00:32:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:3181 write 0x6109d5e thru 0x61121d9 (0x847c bytes) 2024-09-18T00:32:28.724 INFO:teuthology.orchestra.run.smithi081.stdout:3183 punch from 0x5229dec to 0x5233572, (0x9786 bytes) 2024-09-18T00:32:28.724 INFO:teuthology.orchestra.run.smithi081.stdout:3184 read 0x336ea65 thru 0x337b141 (0xc6dd bytes) 2024-09-18T00:32:28.724 INFO:teuthology.orchestra.run.smithi081.stdout:3187 read 0x2f09ac3 thru 0x2f0b1f0 (0x172e bytes) 2024-09-18T00:32:28.724 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:28.724 INFO:teuthology.orchestra.run.smithi081.stdout:3190 read 0x1697905 thru 0x16a6bd7 (0xf2d3 bytes) 2024-09-18T00:32:28.730 INFO:teuthology.orchestra.run.smithi081.stdout:3191 trunc from 0x6ce7c1f to 0xbe34310 2024-09-18T00:32:28.736 INFO:teuthology.orchestra.run.smithi081.stdout:3192 read 0x6d2af24 thru 0x6d32d10 (0x7ded bytes) 2024-09-18T00:32:28.744 INFO:teuthology.orchestra.run.smithi081.stdout:3193 write 0xdb03fb1 thru 0xdb0a19a (0x61ea bytes) 2024-09-18T00:32:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:3196 write 0xd5c2571 thru 0xd5c8e9e (0x692e bytes) 2024-09-18T00:32:28.750 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:28.751 INFO:teuthology.orchestra.run.smithi081.stdout:3198 clone 27 order 23 su 1048576 sc 8 2024-09-18T00:32:28.763 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.763 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.772 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:28.814 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:28.812+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:28.901 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:28.899+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:28.916 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:28.916 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:28.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:29.002 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:29.000+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:29.029 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:29.029 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:29.038 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T00:32:29.062 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T00:32:29.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:32:29.114 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone26 from 0xdb0a19b (overlap 0x94939f) to 0x6800ef 2024-09-18T00:32:29.122 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:29.121+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:29.182 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-18T00:32:29.189 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:29.189 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:29.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:29.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:29.240 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:29.238+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:29.305 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:29.303+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:29.344 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:29.345 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:29.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:29.367 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:29.386 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:29.386 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:29.403 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:29.403 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:29.405 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:29.404+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:29.419 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:29.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:32:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:32:29.446 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:29.447 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:29.456 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-18T00:32:29.046821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":921731839,"num_objects":1114,"num_object_clones":278,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":399,"num_read":83790,"num_read_kb":306443,"num_write":10354,"num_write_kb":208428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8649,"ondisk_log_size":8649,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337176,"kb_used_data":32160,"kb_used_omap":12,"kb_used_meta":304819,"kb_avail":754637544,"statfs":{"total":773094113280,"available":772748845056,"internally_reserved":0,"allocated":32931840,"data_stored":328662973,"data_compressed":6667358,"data_compressed_allocated":20480000,"data_compressed_original":322135400,"omap_allocated":12752,"internal_metadata":312135216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":99586362,"num_objects":72,"num_object_clones":3,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":2,"num_read":3180,"num_read_kb":5998,"num_write":713,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000643"},"pg_stats":[{"pgid":"3.1f","version":"59'164","reported_seq":1841,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034784+0000","last_change":"2024-09-18T00:31:48.867189+0000","last_active":"2024-09-18T00:32:27.034784+0000","last_peered":"2024-09-18T00:32:27.034784+0000","last_clean":"2024-09-18T00:32:27.034784+0000","last_became_active":"2024-09-18T00:31:46.857203+0000","last_became_peered":"2024-09-18T00:31:46.857203+0000","last_unstale":"2024-09-18T00:32:27.034784+0000","last_undegraded":"2024-09-18T00:32:27.034784+0000","last_fullsized":"2024-09-18T00:32:27.034784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:05.851553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011431729999999999,"stat_sum":{"num_bytes":25832432,"num_objects":38,"num_object_clones":11,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":15,"num_read":1823,"num_read_kb":18665,"num_write":156,"num_write_kb":9081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"54'416","reported_seq":1458,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026611+0000","last_change":"2024-09-18T00:31:48.986506+0000","last_active":"2024-09-18T00:32:24.026611+0000","last_peered":"2024-09-18T00:32:24.026611+0000","last_clean":"2024-09-18T00:32:24.026611+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:32:24.026611+0000","last_undegraded":"2024-09-18T00:32:24.026611+0000","last_fullsized":"2024-09-18T00:32:24.026611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:32.661954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078236600000000005,"stat_sum":{"num_bytes":15656719,"num_objects":33,"num_object_clones":8,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":2649,"num_read_kb":19882,"num_write":678,"num_write_kb":12085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"57'204","reported_seq":2312,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020694+0000","last_change":"2024-09-18T00:31:48.858463+0000","last_active":"2024-09-18T00:32:25.020694+0000","last_peered":"2024-09-18T00:32:25.020694+0000","last_clean":"2024-09-18T00:32:25.020694+0000","last_became_active":"2024-09-18T00:31:46.855003+0000","last_became_peered":"2024-09-18T00:31:46.855003+0000","last_unstale":"2024-09-18T00:32:25.020694+0000","last_undegraded":"2024-09-18T00:32:25.020694+0000","last_fullsized":"2024-09-18T00:32:25.020694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:23.919981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048435299999999998,"stat_sum":{"num_bytes":45828419,"num_objects":47,"num_object_clones":10,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":14,"num_read":2520,"num_read_kb":30889,"num_write":200,"num_write_kb":17277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"58'454","reported_seq":3388,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.063931+0000","last_change":"2024-09-18T00:31:48.858226+0000","last_active":"2024-09-18T00:32:25.063931+0000","last_peered":"2024-09-18T00:32:25.063931+0000","last_clean":"2024-09-18T00:32:25.063931+0000","last_became_active":"2024-09-18T00:31:46.854720+0000","last_became_peered":"2024-09-18T00:31:46.854720+0000","last_unstale":"2024-09-18T00:32:25.063931+0000","last_undegraded":"2024-09-18T00:32:25.063931+0000","last_fullsized":"2024-09-18T00:32:25.063931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:43.911277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039719499999999998,"stat_sum":{"num_bytes":100074887,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":3984,"num_read_kb":5540,"num_write":584,"num_write_kb":9943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"59'554","reported_seq":1870,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034889+0000","last_change":"2024-09-18T00:31:48.867301+0000","last_active":"2024-09-18T00:32:27.034889+0000","last_peered":"2024-09-18T00:32:27.034889+0000","last_clean":"2024-09-18T00:32:27.034889+0000","last_became_active":"2024-09-18T00:31:46.859322+0000","last_became_peered":"2024-09-18T00:31:46.859322+0000","last_unstale":"2024-09-18T00:32:27.034889+0000","last_undegraded":"2024-09-18T00:32:27.034889+0000","last_fullsized":"2024-09-18T00:32:27.034889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:18.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012412110000000001,"stat_sum":{"num_bytes":12405012,"num_objects":32,"num_object_clones":6,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":3538,"num_read_kb":3915,"num_write":890,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"56'177","reported_seq":3054,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.055669+0000","last_change":"2024-09-18T00:31:48.860421+0000","last_active":"2024-09-18T00:32:25.055669+0000","last_peered":"2024-09-18T00:32:25.055669+0000","last_clean":"2024-09-18T00:32:25.055669+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:32:25.055669+0000","last_undegraded":"2024-09-18T00:32:25.055669+0000","last_fullsized":"2024-09-18T00:32:25.055669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:27.435565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089020699999999996,"stat_sum":{"num_bytes":77444124,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":3110,"num_read_kb":18193,"num_write":173,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"58'268","reported_seq":876,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.067301+0000","last_change":"2024-09-18T00:31:48.856023+0000","last_active":"2024-09-18T00:32:25.067301+0000","last_peered":"2024-09-18T00:32:25.067301+0000","last_clean":"2024-09-18T00:32:25.067301+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:32:25.067301+0000","last_undegraded":"2024-09-18T00:32:25.067301+0000","last_fullsized":"2024-09-18T00:32:25.067301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:23:07.491381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050127899999999998,"stat_sum":{"num_bytes":14983899,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":1481,"num_read_kb":1654,"num_write":337,"num_write_kb":1426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"55'182","reported_seq":2047,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026306+0000","last_change":"2024-09-18T00:31:48.986343+0000","last_active":"2024-09-18T00:32:24.026306+0000","last_peered":"2024-09-18T00:32:24.026306+0000","last_clean":"2024-09-18T00:32:24.026306+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:32:24.026306+0000","last_undegraded":"2024-09-18T00:32:24.026306+0000","last_fullsized":"2024-09-18T00:32:24.026306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:40.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065419800000000004,"stat_sum":{"num_bytes":10303540,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":2358,"num_read_kb":3861,"num_write":168,"num_write_kb":1986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"59'177","reported_seq":906,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034850+0000","last_change":"2024-09-18T00:31:48.867375+0000","last_active":"2024-09-18T00:32:27.034850+0000","last_peered":"2024-09-18T00:32:27.034850+0000","last_clean":"2024-09-18T00:32:27.034850+0000","last_became_active":"2024-09-18T00:31:46.858297+0000","last_became_peered":"2024-09-18T00:31:46.858297+0000","last_unstale":"2024-09-18T00:32:27.034850+0000","last_undegraded":"2024-09-18T00:32:27.034850+0000","last_fullsized":"2024-09-18T00:32:27.034850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:56:03.694174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012184100000000001,"stat_sum":{"num_bytes":24190222,"num_objects":28,"num_object_clones":7,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":8,"num_read":1039,"num_read_kb":1734,"num_write":216,"num_write_kb":1155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"56'263","reported_seq":1565,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020462+0000","last_change":"2024-09-18T00:31:48.858308+0000","last_active":"2024-09-18T00:32:25.020462+0000","last_peered":"2024-09-18T00:32:25.020462+0000","last_clean":"2024-09-18T00:32:25.020462+0000","last_became_active":"2024-09-18T00:31:46.851617+0000","last_became_peered":"2024-09-18T00:31:46.851617+0000","last_unstale":"2024-09-18T00:32:25.020462+0000","last_undegraded":"2024-09-18T00:32:25.020462+0000","last_fullsized":"2024-09-18T00:32:25.020462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:30.122009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035842399999999998,"stat_sum":{"num_bytes":13308343,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":16,"num_read":2511,"num_read_kb":3640,"num_write":294,"num_write_kb":1327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"57'173","reported_seq":1544,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051538+0000","last_change":"2024-09-18T00:31:48.871844+0000","last_active":"2024-09-18T00:32:25.051538+0000","last_peered":"2024-09-18T00:32:25.051538+0000","last_clean":"2024-09-18T00:32:25.051538+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:32:25.051538+0000","last_undegraded":"2024-09-18T00:32:25.051538+0000","last_fullsized":"2024-09-18T00:32:25.051538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:09.524168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037964800000000001,"stat_sum":{"num_bytes":39660049,"num_objects":29,"num_object_clones":5,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":13,"num_read":1357,"num_read_kb":2379,"num_write":159,"num_write_kb":1995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"58'172","reported_seq":2167,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.029743+0000","last_change":"2024-09-18T00:31:48.860473+0000","last_active":"2024-09-18T00:32:25.029743+0000","last_peered":"2024-09-18T00:32:25.029743+0000","last_clean":"2024-09-18T00:32:25.029743+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:32:25.029743+0000","last_undegraded":"2024-09-18T00:32:25.029743+0000","last_fullsized":"2024-09-18T00:32:25.029743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:54.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090479700000000004,"stat_sum":{"num_bytes":33320578,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":1973,"num_read_kb":19489,"num_write":170,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.047893+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:32:24.047893+0000","last_peered":"2024-09-18T00:32:24.047893+0000","last_clean":"2024-09-18T00:32:24.047893+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:32:24.047893+0000","last_undegraded":"2024-09-18T00:32:24.047893+0000","last_fullsized":"2024-09-18T00:32:24.047893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"59'160","reported_seq":1090,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034849+0000","last_change":"2024-09-18T00:31:48.867043+0000","last_active":"2024-09-18T00:32:27.034849+0000","last_peered":"2024-09-18T00:32:27.034849+0000","last_clean":"2024-09-18T00:32:27.034849+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:32:27.034849+0000","last_undegraded":"2024-09-18T00:32:27.034849+0000","last_fullsized":"2024-09-18T00:32:27.034849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:40:39.831486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010540840000000001,"stat_sum":{"num_bytes":6292737,"num_objects":26,"num_object_clones":8,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":1011,"num_read_kb":2230,"num_write":175,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020599+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:32:25.020599+0000","last_peered":"2024-09-18T00:32:25.020599+0000","last_clean":"2024-09-18T00:32:25.020599+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:32:25.020599+0000","last_undegraded":"2024-09-18T00:32:25.020599+0000","last_fullsized":"2024-09-18T00:32:25.020599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'269","reported_seq":2269,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026585+0000","last_change":"2024-09-18T00:31:48.986721+0000","last_active":"2024-09-18T00:32:24.026585+0000","last_peered":"2024-09-18T00:32:24.026585+0000","last_clean":"2024-09-18T00:32:24.026585+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:32:24.026585+0000","last_undegraded":"2024-09-18T00:32:24.026585+0000","last_fullsized":"2024-09-18T00:32:24.026585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:19:38.825780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094052899999999995,"stat_sum":{"num_bytes":2817336,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":13,"num_read":2533,"num_read_kb":1696,"num_write":338,"num_write_kb":7489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051643+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:32:25.051643+0000","last_peered":"2024-09-18T00:32:25.051643+0000","last_clean":"2024-09-18T00:32:25.051643+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:32:25.051643+0000","last_undegraded":"2024-09-18T00:32:25.051643+0000","last_fullsized":"2024-09-18T00:32:25.051643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'280","reported_seq":1858,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020418+0000","last_change":"2024-09-18T00:31:48.855715+0000","last_active":"2024-09-18T00:32:25.020418+0000","last_peered":"2024-09-18T00:32:25.020418+0000","last_clean":"2024-09-18T00:32:25.020418+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:32:25.020418+0000","last_undegraded":"2024-09-18T00:32:25.020418+0000","last_fullsized":"2024-09-18T00:32:25.020418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:14.275967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028487899999999998,"stat_sum":{"num_bytes":70492359,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":2158,"num_read_kb":4498,"num_write":280,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020528+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:32:25.020528+0000","last_peered":"2024-09-18T00:32:25.020528+0000","last_clean":"2024-09-18T00:32:25.020528+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:32:25.020528+0000","last_undegraded":"2024-09-18T00:32:25.020528+0000","last_fullsized":"2024-09-18T00:32:25.020528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"57'507","reported_seq":1521,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020586+0000","last_change":"2024-09-18T00:31:48.858535+0000","last_active":"2024-09-18T00:32:25.020586+0000","last_peered":"2024-09-18T00:32:25.020586+0000","last_clean":"2024-09-18T00:32:25.020586+0000","last_became_active":"2024-09-18T00:31:46.852261+0000","last_became_peered":"2024-09-18T00:31:46.852261+0000","last_unstale":"2024-09-18T00:32:25.020586+0000","last_undegraded":"2024-09-18T00:32:25.020586+0000","last_fullsized":"2024-09-18T00:32:25.020586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:11.483068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053830299999999996,"stat_sum":{"num_bytes":41158459,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":2743,"num_read_kb":4036,"num_write":732,"num_write_kb":1512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"56'123","reported_seq":643,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.029637+0000","last_change":"2024-09-18T00:31:48.860661+0000","last_active":"2024-09-18T00:32:25.029637+0000","last_peered":"2024-09-18T00:32:25.029637+0000","last_clean":"2024-09-18T00:32:25.029637+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:32:25.029637+0000","last_undegraded":"2024-09-18T00:32:25.029637+0000","last_fullsized":"2024-09-18T00:32:25.029637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:05.510256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094755499999999999,"stat_sum":{"num_bytes":13605405,"num_objects":22,"num_object_clones":4,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":12,"num_read":466,"num_read_kb":1613,"num_write":111,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":95,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020310+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:32:25.020310+0000","last_peered":"2024-09-18T00:32:25.020310+0000","last_clean":"2024-09-18T00:32:25.020310+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:32:25.020310+0000","last_undegraded":"2024-09-18T00:32:25.020310+0000","last_fullsized":"2024-09-18T00:32:25.020310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"56'199","reported_seq":1131,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020366+0000","last_change":"2024-09-18T00:31:48.855777+0000","last_active":"2024-09-18T00:32:25.020366+0000","last_peered":"2024-09-18T00:32:25.020366+0000","last_clean":"2024-09-18T00:32:25.020366+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:32:25.020366+0000","last_undegraded":"2024-09-18T00:32:25.020366+0000","last_fullsized":"2024-09-18T00:32:25.020366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:55.167995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032180899999999999,"stat_sum":{"num_bytes":24407438,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":915,"num_read_kb":2398,"num_write":168,"num_write_kb":8381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.015762+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:32:24.015762+0000","last_peered":"2024-09-18T00:32:24.015762+0000","last_clean":"2024-09-18T00:32:24.015762+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:32:24.015762+0000","last_undegraded":"2024-09-18T00:32:24.015762+0000","last_fullsized":"2024-09-18T00:32:24.015762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'147","reported_seq":4550,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034628+0000","last_change":"2024-09-18T00:31:48.866306+0000","last_active":"2024-09-18T00:32:27.034628+0000","last_peered":"2024-09-18T00:32:27.034628+0000","last_clean":"2024-09-18T00:32:27.034628+0000","last_became_active":"2024-09-18T00:31:46.858165+0000","last_became_peered":"2024-09-18T00:31:46.858165+0000","last_unstale":"2024-09-18T00:32:27.034628+0000","last_undegraded":"2024-09-18T00:32:27.034628+0000","last_fullsized":"2024-09-18T00:32:27.034628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:44.704161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054274200000000003,"stat_sum":{"num_bytes":30547303,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":11,"num_read":4397,"num_read_kb":20760,"num_write":144,"num_write_kb":8164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051352+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:32:25.051352+0000","last_peered":"2024-09-18T00:32:25.051352+0000","last_clean":"2024-09-18T00:32:25.051352+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:32:25.051352+0000","last_undegraded":"2024-09-18T00:32:25.051352+0000","last_fullsized":"2024-09-18T00:32:25.051352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"57'150","reported_seq":2146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.061633+0000","last_change":"2024-09-18T00:31:48.985967+0000","last_active":"2024-09-18T00:32:24.061633+0000","last_peered":"2024-09-18T00:32:24.061633+0000","last_clean":"2024-09-18T00:32:24.061633+0000","last_became_active":"2024-09-18T00:31:46.853986+0000","last_became_peered":"2024-09-18T00:31:46.853986+0000","last_unstale":"2024-09-18T00:32:24.061633+0000","last_undegraded":"2024-09-18T00:32:24.061633+0000","last_fullsized":"2024-09-18T00:32:24.061633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:17.561598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043793499999999997,"stat_sum":{"num_bytes":25684339,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":1991,"num_read_kb":19296,"num_write":149,"num_write_kb":15083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":94,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020324+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:32:25.020324+0000","last_peered":"2024-09-18T00:32:25.020324+0000","last_clean":"2024-09-18T00:32:25.020324+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:32:25.020324+0000","last_undegraded":"2024-09-18T00:32:25.020324+0000","last_fullsized":"2024-09-18T00:32:25.020324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051363+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:32:25.051363+0000","last_peered":"2024-09-18T00:32:25.051363+0000","last_clean":"2024-09-18T00:32:25.051363+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:32:25.051363+0000","last_undegraded":"2024-09-18T00:32:25.051363+0000","last_fullsized":"2024-09-18T00:32:25.051363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"54'280","reported_seq":3320,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026312+0000","last_change":"2024-09-18T00:31:48.986780+0000","last_active":"2024-09-18T00:32:24.026312+0000","last_peered":"2024-09-18T00:32:24.026312+0000","last_clean":"2024-09-18T00:32:24.026312+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:32:24.026312+0000","last_undegraded":"2024-09-18T00:32:24.026312+0000","last_fullsized":"2024-09-18T00:32:24.026312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:31:43.140520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092255199999999999,"stat_sum":{"num_bytes":11262425,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":5269,"num_read_kb":6526,"num_write":272,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"58'227","reported_seq":3956,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.047346+0000","last_change":"2024-09-18T00:31:48.859894+0000","last_active":"2024-09-18T00:32:25.047346+0000","last_peered":"2024-09-18T00:32:25.047346+0000","last_clean":"2024-09-18T00:32:25.047346+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:32:25.047346+0000","last_undegraded":"2024-09-18T00:32:25.047346+0000","last_fullsized":"2024-09-18T00:32:25.047346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:40.017683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037794800000000002,"stat_sum":{"num_bytes":36512384,"num_objects":38,"num_object_clones":11,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":4760,"num_read_kb":9891,"num_write":213,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"57'153","reported_seq":2483,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.063982+0000","last_change":"2024-09-18T00:31:48.985698+0000","last_active":"2024-09-18T00:32:24.063982+0000","last_peered":"2024-09-18T00:32:24.063982+0000","last_clean":"2024-09-18T00:32:24.063982+0000","last_became_active":"2024-09-18T00:31:46.855822+0000","last_became_peered":"2024-09-18T00:31:46.855822+0000","last_unstale":"2024-09-18T00:32:24.063982+0000","last_undegraded":"2024-09-18T00:32:24.063982+0000","last_fullsized":"2024-09-18T00:32:24.063982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:48.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030723799999999999,"stat_sum":{"num_bytes":5595702,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":2772,"num_read_kb":2919,"num_write":138,"num_write_kb":813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"56'238","reported_seq":1004,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026351+0000","last_change":"2024-09-18T00:31:48.986238+0000","last_active":"2024-09-18T00:32:24.026351+0000","last_peered":"2024-09-18T00:32:24.026351+0000","last_clean":"2024-09-18T00:32:24.026351+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:32:24.026351+0000","last_undegraded":"2024-09-18T00:32:24.026351+0000","last_fullsized":"2024-09-18T00:32:24.026351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:08.514746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063642199999999999,"stat_sum":{"num_bytes":19606156,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":18,"num_read":1104,"num_read_kb":3473,"num_write":250,"num_write_kb":9893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"55'147","reported_seq":1167,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020483+0000","last_change":"2024-09-18T00:31:48.858730+0000","last_active":"2024-09-18T00:32:25.020483+0000","last_peered":"2024-09-18T00:32:25.020483+0000","last_clean":"2024-09-18T00:32:25.020483+0000","last_became_active":"2024-09-18T00:31:46.851057+0000","last_became_peered":"2024-09-18T00:31:46.851057+0000","last_unstale":"2024-09-18T00:32:25.020483+0000","last_undegraded":"2024-09-18T00:32:25.020483+0000","last_fullsized":"2024-09-18T00:32:25.020483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:47.077748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069353299999999998,"stat_sum":{"num_bytes":13708247,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":975,"num_read_kb":2512,"num_write":130,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"54'328","reported_seq":3546,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051556+0000","last_change":"2024-09-18T00:31:48.872219+0000","last_active":"2024-09-18T00:32:25.051556+0000","last_peered":"2024-09-18T00:32:25.051556+0000","last_clean":"2024-09-18T00:32:25.051556+0000","last_became_active":"2024-09-18T00:31:46.853922+0000","last_became_peered":"2024-09-18T00:31:46.853922+0000","last_unstale":"2024-09-18T00:32:25.051556+0000","last_undegraded":"2024-09-18T00:32:25.051556+0000","last_fullsized":"2024-09-18T00:32:25.051556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:39:03.731596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063734100000000004,"stat_sum":{"num_bytes":55229265,"num_objects":45,"num_object_clones":14,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":16,"num_read":5221,"num_read_kb":6454,"num_write":343,"num_write_kb":1907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"55'493","reported_seq":3914,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051670+0000","last_change":"2024-09-18T00:31:48.871997+0000","last_active":"2024-09-18T00:32:25.051670+0000","last_peered":"2024-09-18T00:32:25.051670+0000","last_clean":"2024-09-18T00:32:25.051670+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:32:25.051670+0000","last_undegraded":"2024-09-18T00:32:25.051670+0000","last_fullsized":"2024-09-18T00:32:25.051670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:36.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052206099999999999,"stat_sum":{"num_bytes":18050580,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":5847,"num_read_kb":8737,"num_write":616,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"56'148","reported_seq":2088,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051603+0000","last_change":"2024-09-18T00:31:48.872116+0000","last_active":"2024-09-18T00:32:25.051603+0000","last_peered":"2024-09-18T00:32:25.051603+0000","last_clean":"2024-09-18T00:32:25.051603+0000","last_became_active":"2024-09-18T00:31:46.858825+0000","last_became_peered":"2024-09-18T00:31:46.858825+0000","last_unstale":"2024-09-18T00:32:25.051603+0000","last_undegraded":"2024-09-18T00:32:25.051603+0000","last_fullsized":"2024-09-18T00:32:25.051603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:16.321649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057934999999999996,"stat_sum":{"num_bytes":11522202,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":16,"num_read":2202,"num_read_kb":2377,"num_write":127,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"57'182","reported_seq":1825,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.245558+0000","last_change":"2024-09-18T00:31:48.985662+0000","last_active":"2024-09-18T00:32:24.245558+0000","last_peered":"2024-09-18T00:32:24.245558+0000","last_clean":"2024-09-18T00:32:24.245558+0000","last_became_active":"2024-09-18T00:31:46.856661+0000","last_became_peered":"2024-09-18T00:31:46.856661+0000","last_unstale":"2024-09-18T00:32:24.245558+0000","last_undegraded":"2024-09-18T00:32:24.245558+0000","last_fullsized":"2024-09-18T00:32:24.245558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:48:20.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027370699999999999,"stat_sum":{"num_bytes":11637646,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":1637,"num_read_kb":5018,"num_write":161,"num_write_kb":9616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"57'867","reported_seq":2336,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.056254+0000","last_change":"2024-09-18T00:32:01.924094+0000","last_active":"2024-09-18T00:32:25.056254+0000","last_peered":"2024-09-18T00:32:25.056254+0000","last_clean":"2024-09-18T00:32:25.056254+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:32:25.056254+0000","last_undegraded":"2024-09-18T00:32:25.056254+0000","last_fullsized":"2024-09-18T00:32:25.056254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:46.445036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035443699999999998,"stat_sum":{"num_bytes":31054303,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":11,"num_read":6118,"num_read_kb":20612,"num_write":1426,"num_write_kb":9754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"57'256","reported_seq":1906,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034688+0000","last_change":"2024-09-18T00:31:48.866261+0000","last_active":"2024-09-18T00:32:27.034688+0000","last_peered":"2024-09-18T00:32:27.034688+0000","last_clean":"2024-09-18T00:32:27.034688+0000","last_became_active":"2024-09-18T00:31:46.858545+0000","last_became_peered":"2024-09-18T00:31:46.858545+0000","last_unstale":"2024-09-18T00:32:27.034688+0000","last_undegraded":"2024-09-18T00:32:27.034688+0000","last_fullsized":"2024-09-18T00:32:27.034688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:41:24.153047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047466899999999999,"stat_sum":{"num_bytes":61930739,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":2221,"num_read_kb":48661,"num_write":231,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"54'171","reported_seq":1167,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051452+0000","last_change":"2024-09-18T00:31:48.872343+0000","last_active":"2024-09-18T00:32:25.051452+0000","last_peered":"2024-09-18T00:32:25.051452+0000","last_clean":"2024-09-18T00:32:25.051452+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:32:25.051452+0000","last_undegraded":"2024-09-18T00:32:25.051452+0000","last_fullsized":"2024-09-18T00:32:25.051452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:05.251506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066573000000000001,"stat_sum":{"num_bytes":17018203,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":991,"num_read_kb":2795,"num_write":164,"num_write_kb":1858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":921141452,"num_objects":1110,"num_object_clones":278,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1110,"num_whiteouts":399,"num_read":83674,"num_read_kb":306343,"num_write":10193,"num_write_kb":206010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28614656,"data_stored":326565779,"data_compressed":7192273,"data_compressed_allocated":21041152,"data_compressed_original":322213224,"omap_allocated":0,"internal_metadata":0},"log_size":8529,"ondisk_log_size":8529,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45096,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326744,"statfs":{"total":96636764160,"available":96590585856,"internally_reserved":0,"allocated":5718016,"data_stored":65877992,"data_compressed":1154795,"data_compressed_allocated":3932160,"data_compressed_original":64890447,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1794048,"data_stored":13271720,"data_compressed":130953,"data_compressed_allocated":884736,"data_compressed_original":12838912,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40352,"kb_used_data":5000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331488,"statfs":{"total":96636764160,"available":96595443712,"internally_reserved":0,"allocated":5120000,"data_stored":47829715,"data_compressed":1213506,"data_compressed_allocated":3366912,"data_compressed_original":46913416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63920,"kb_used_data":6356,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307920,"statfs":{"total":96636764160,"available":96571310080,"internally_reserved":0,"allocated":6508544,"data_stored":85055869,"data_compressed":1213275,"data_compressed_allocated":4419584,"data_compressed_original":83904640,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37880,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333960,"statfs":{"total":96636764160,"available":96597975040,"internally_reserved":0,"allocated":2592768,"data_stored":20249544,"data_compressed":673202,"data_compressed_allocated":1249280,"data_compressed_original":19580933,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43116,"kb_used_data":3612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328724,"statfs":{"total":96636764160,"available":96592613376,"internally_reserved":0,"allocated":3698688,"data_stored":25096981,"data_compressed":679619,"data_compressed_allocated":2056192,"data_compressed_original":24255704,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1716224,"data_stored":6416331,"data_compressed":484123,"data_compressed_allocated":679936,"data_compressed_original":5896192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40996,"kb_used_data":5648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330844,"statfs":{"total":96636764160,"available":96594784256,"internally_reserved":0,"allocated":5783552,"data_stored":64864821,"data_compressed":1117885,"data_compressed_allocated":3891200,"data_compressed_original":63855156,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5296128,"data_stored":64388544,"data_compressed":1217967,"data_compressed_allocated":3989504,"data_compressed_original":63650356,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1941504,"data_stored":19960578,"data_compressed":673202,"data_compressed_allocated":1249280,"data_compressed_original":19580933,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1077248,"data_stored":6133519,"data_compressed":484123,"data_compressed_allocated":679936,"data_compressed_original":5896192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3059712,"data_stored":24814169,"data_compressed":679619,"data_compressed_allocated":2056192,"data_compressed_original":24255704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":85233895,"data_compressed":1417928,"data_compressed_allocated":4657152,"data_compressed_original":84310144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4571136,"data_stored":47670380,"data_compressed":1277461,"data_compressed_allocated":3440640,"data_compressed_original":47028104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1142784,"data_stored":12982757,"data_compressed":130953,"data_compressed_allocated":884736,"data_compressed_original":12838912,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":65381937,"data_compressed":1311020,"data_compressed_allocated":4083712,"data_compressed_original":64652879,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:32:29.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:32:29.459 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:29.460 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:29.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:29.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:29.495 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:29.507 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:29.505+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:29.512 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:29.512 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:3199 punch from 0xd5a32b3 to 0xd5a8962, (0x56af bytes) 2024-09-18T00:32:29.519 INFO:teuthology.orchestra.run.smithi081.stdout:3200 read 0x20c5427 thru 0x20d0556 (0xb130 bytes) 2024-09-18T00:32:29.519 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.519 INFO:teuthology.orchestra.run.smithi081.stdout:3203 write 0x11ffdfb thru 0x120f263 (0xf469 bytes) 2024-09-18T00:32:29.529 INFO:teuthology.orchestra.run.smithi081.stdout:3204 read 0xcfba0ba thru 0xcfbb3f3 (0x133a bytes) 2024-09-18T00:32:29.529 INFO:teuthology.orchestra.run.smithi081.stdout:3205 write 0xc71263e thru 0xc71e5bd (0xbf80 bytes) 2024-09-18T00:32:29.533 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.533 INFO:teuthology.orchestra.run.smithi081.stdout:3209 read 0x1faaba8 thru 0x1faede1 (0x423a bytes) 2024-09-18T00:32:29.533 INFO:teuthology.orchestra.run.smithi081.stdout:3210 flatten 2024-09-18T00:32:29.555 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.555 INFO:teuthology.orchestra.run.smithi081.stdout:3212 read 0xd06ca48 thru 0xd079705 (0xccbe bytes) 2024-09-18T00:32:29.555 INFO:teuthology.orchestra.run.smithi081.stdout:3213 write 0x96d357d thru 0x96d393d (0x3c1 bytes) 2024-09-18T00:32:29.557 INFO:teuthology.orchestra.run.smithi081.stdout:3215 read 0x3069072 thru 0x306a626 (0x15b5 bytes) 2024-09-18T00:32:29.558 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.558 INFO:teuthology.orchestra.run.smithi081.stdout:3219 read 0x6ececd9 thru 0x6ed454d (0x5875 bytes) 2024-09-18T00:32:29.558 INFO:teuthology.orchestra.run.smithi081.stdout:3220 read 0xb9a51c8 thru 0xb9ab77d (0x65b6 bytes) 2024-09-18T00:32:29.561 INFO:teuthology.orchestra.run.smithi081.stdout:3221 trunc from 0xdb0a19b to 0xacfb4f8 2024-09-18T00:32:29.573 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.573 INFO:teuthology.orchestra.run.smithi081.stdout:3226 read 0x936261c thru 0x9365a83 (0x3468 bytes) 2024-09-18T00:32:29.573 INFO:teuthology.orchestra.run.smithi081.stdout:3228 read 0x56a1f9 thru 0x56fe35 (0x5c3d bytes) 2024-09-18T00:32:29.573 INFO:teuthology.orchestra.run.smithi081.stdout:3229 read 0x217940d thru 0x21836ce (0xa2c2 bytes) 2024-09-18T00:32:29.574 INFO:teuthology.orchestra.run.smithi081.stdout:3231 write 0xa60a1f4 thru 0xa60ffa6 (0x5db3 bytes) 2024-09-18T00:32:29.575 INFO:teuthology.orchestra.run.smithi081.stdout:3232 punch from 0x1478be7 to 0x1483b1b, (0xaf34 bytes) 2024-09-18T00:32:29.575 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.584 INFO:teuthology.orchestra.run.smithi081.stdout:3235 writesame 0xd2ebec4 thru 0xd2efa3c data_size 0x23(0x3b79 bytes) 2024-09-18T00:32:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:3237 read 0x2fd15ca thru 0x2fd2f7f (0x19b6 bytes) 2024-09-18T00:32:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:3238 writesame 0x5c3d323 thru 0x5c4a230 data_size 0x11(0xcf0e bytes) 2024-09-18T00:32:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:3239 read 0x1676d72 thru 0x167a10d (0x339c bytes) 2024-09-18T00:32:29.603 INFO:teuthology.orchestra.run.smithi081.stdout:3241 trunc from 0xd2efa3d to 0x26c4bed 2024-09-18T00:32:29.607 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:29.606+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:29.615 INFO:teuthology.orchestra.run.smithi081.stdout:3242 read 0xc39029 thru 0xc45c18 (0xcbf0 bytes) 2024-09-18T00:32:29.622 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:29.622 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:29.622 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:29.622 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:29.622 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:29.629 INFO:teuthology.orchestra.run.smithi081.stdout:3243 write 0xa02c307 thru 0xa0374a5 (0xb19f bytes) 2024-09-18T00:32:29.633 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:29.641 INFO:teuthology.orchestra.run.smithi081.stdout:3244 trunc from 0xa0374a6 to 0x2265f12 2024-09-18T00:32:29.654 INFO:teuthology.orchestra.run.smithi081.stdout:3245 punch from 0xf30eac to 0xf3ec3d, (0xdd91 bytes) 2024-09-18T00:32:29.656 INFO:teuthology.orchestra.run.smithi081.stdout:3246 trunc from 0x2265f12 to 0x3272cd7 2024-09-18T00:32:29.681 INFO:teuthology.orchestra.run.smithi081.stdout:3247 writesame 0xed209bd thru 0xed2403e data_size 0x1(0x3682 bytes) 2024-09-18T00:32:29.685 INFO:teuthology.orchestra.run.smithi081.stdout:3248 write 0xed6fc23 thru 0xed769b6 (0x6d94 bytes) 2024-09-18T00:32:29.688 INFO:teuthology.orchestra.run.smithi081.stdout:3249 punch from 0x955f80e to 0x956e59d, (0xed8f bytes) 2024-09-18T00:32:29.688 INFO:teuthology.orchestra.run.smithi081.stdout:3250 write 0x562e45c thru 0x56331ce (0x4d73 bytes) 2024-09-18T00:32:29.691 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.691 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.697 INFO:teuthology.orchestra.run.smithi081.stdout:3253 trunc from 0xed769b7 to 0xa32d328 2024-09-18T00:32:29.714 INFO:teuthology.orchestra.run.smithi081.stdout:3254 write 0xc53c047 thru 0xc549075 (0xd02f bytes) 2024-09-18T00:32:29.716 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:29.715+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:29.717 INFO:teuthology.orchestra.run.smithi081.stdout:3255 write 0xc1de77c thru 0xc1e5797 (0x701c bytes) 2024-09-18T00:32:29.721 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.721 INFO:teuthology.orchestra.run.smithi081.stdout:3257 write 0x59b9ea1 thru 0x59bdfa1 (0x4101 bytes) 2024-09-18T00:32:29.724 INFO:teuthology.orchestra.run.smithi081.stdout:3259 write 0x641a5f6 thru 0x641cf5c (0x2967 bytes) 2024-09-18T00:32:29.727 INFO:teuthology.orchestra.run.smithi081.stdout:3261 write 0xb5449db thru 0xb55238c (0xd9b2 bytes) 2024-09-18T00:32:29.731 INFO:teuthology.orchestra.run.smithi081.stdout:3262 writesame 0x8c3121b thru 0x8c39c36 data_size 0x2(0x8a1c bytes) 2024-09-18T00:32:29.742 INFO:teuthology.orchestra.run.smithi081.stdout:3263 read 0x17bc12d thru 0x17cb63f (0xf513 bytes) 2024-09-18T00:32:29.743 INFO:teuthology.orchestra.run.smithi081.stdout:3266 read 0x1e3f4e8 thru 0x1e42bab (0x36c4 bytes) 2024-09-18T00:32:29.755 INFO:teuthology.orchestra.run.smithi081.stdout:3267 trunc from 0xc549076 to 0x2a3bd61 2024-09-18T00:32:29.781 INFO:teuthology.orchestra.run.smithi081.stdout:3268 write 0x82a9707 thru 0x82b4e06 (0xb700 bytes) 2024-09-18T00:32:29.788 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:29.788 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:29.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1631 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 675840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.432877734999998, 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047626628999999997, 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.789 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1631 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353197+0000", 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353198+0000", 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2449999999999999e-06 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353201+0000", 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.399e-06 2024-09-18T00:32:29.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353205+0000", 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5760000000000002e-06 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400685+0000", 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047480517999999999 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400769+0000", 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3473000000000005e-05 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400823+0000", 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4137e-05 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1632 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.793 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.432865671000002, 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047756706000000003, 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1632 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.794 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353209+0000", 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353210+0000", 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.514e-06 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353216+0000", 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3920000000000002e-06 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353219+0000", 2024-09-18T00:32:29.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.315e-06 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400849+0000", 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047630231000000002 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400901+0000", 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1428999999999998e-05 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400965+0000", 2024-09-18T00:32:29.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4543999999999997e-05 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1633 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.432851149000001, 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868945000000003, 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.798 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1633 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354886+0000", 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001662979 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354890+0000", 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354899+0000", 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3510000000000008e-06 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354906+0000", 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5869999999999998e-06 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400994+0000", 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046087545000000001 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.801 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401038+0000", 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4535e-05 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401092+0000", 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3687999999999998e-05 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.802 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1682 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 47104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.430965950999997, 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047536968999999998, 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1682 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0100000000000001e-07 2024-09-18T00:32:29.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355109+0000", 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8899999999999998e-07 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355112+0000", 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8770000000000002e-06 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355115+0000", 2024-09-18T00:32:29.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4030000000000001e-06 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402556+0000", 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047441715000000002 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402596+0000", 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9635000000000003e-05 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402645+0000", 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9149e-05 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1683 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.430956492, 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047646796999999998, 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1683 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356882+0000", 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001764334 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356890+0000", 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4759999999999998e-06 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356901+0000", 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0533999999999999e-05 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356912+0000", 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1239e-05 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402670+0000", 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045757985000000001 2024-09-18T00:32:29.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402713+0000", 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3121000000000003e-05 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402764+0000", 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1107999999999999e-05 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1705 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 706560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.427014806999999, 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047596718000000003, 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1705 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360881+0000", 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001821802 2024-09-18T00:32:29.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360885+0000", 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4809999999999998e-06 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360892+0000", 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360896+0000", 2024-09-18T00:32:29.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6140000000000002e-06 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406437+0000", 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045540046000000001 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406544+0000", 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107112 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406656+0000", 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011232500000000001 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.816 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1715 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 993280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.425016765000002, 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047689281, 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1715 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361058+0000", 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361059+0000", 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.697e-06 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361065+0000", 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.507e-06 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361069+0000", 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.442e-06 2024-09-18T00:32:29.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408546+0000", 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047476566999999997 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408638+0000", 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2218000000000004e-05 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408747+0000", 2024-09-18T00:32:29.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108528 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1716 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 1021952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.424999143999997, 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047884890999999999, 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.821 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1716 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361077+0000", 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.823e-06 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361085+0000", 2024-09-18T00:32:29.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5889999999999997e-06 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361089+0000", 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.651e-06 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408783+0000", 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047693194000000001 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408861+0000", 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8220000000000007e-05 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408960+0000", 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9049999999999995e-05 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1754 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 20480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:29.825 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.424979155000003, 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048097325000000003, 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1754 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:29.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361097+0000", 2024-09-18T00:32:29.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.714e-06 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361104+0000", 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8580000000000002e-06 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361117+0000", 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3118e-05 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408998+0000", 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047881263 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409088+0000", 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9918000000000002e-05 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409192+0000", 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104079 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1755 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.424950336000002, 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048258826999999997, 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1755 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.830 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.32e-07 2024-09-18T00:32:29.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361126+0000", 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1059999999999998e-06 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361132+0000", 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0299999999999999e-06 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361137+0000", 2024-09-18T00:32:29.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409215+0000", 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048078567000000003 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409294+0000", 2024-09-18T00:32:29.833 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8467999999999995e-05 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409383+0000", 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8840999999999999e-05 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1756 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 77824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.424931676, 2024-09-18T00:32:29.834 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048360829000000001, 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1756 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361143+0000", 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361154+0000", 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1336e-05 2024-09-18T00:32:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361161+0000", 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2629999999999997e-06 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361171+0000", 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3049999999999998e-06 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409408+0000", 2024-09-18T00:32:29.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048237447000000003 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409451+0000", 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3284000000000001e-05 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409503+0000", 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1833000000000003e-05 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1757 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.424896246000003, 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048438623, 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1757 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362883+0000", 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017047620000000001 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362887+0000", 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1690000000000002e-06 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362897+0000", 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0362e-05 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362905+0000", 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6369999999999999e-06 2024-09-18T00:32:29.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409527+0000", 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046622334000000001 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409566+0000", 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9427e-05 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409616+0000", 2024-09-18T00:32:29.842 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9932000000000002e-05 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1764 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 307200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.422995528000001, 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047564585999999999, 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.843 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1764 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.844 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363081+0000", 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.869e-06 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363087+0000", 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.387e-06 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363092+0000", 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410478+0000", 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047385746999999999 2024-09-18T00:32:29.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410535+0000", 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7154999999999997e-05 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410643+0000", 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108311 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1765 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.422975598999997, 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047660415999999997, 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1765 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.848 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363099+0000", 2024-09-18T00:32:29.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363102+0000", 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.898e-06 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363108+0000", 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.850 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363118+0000", 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9969999999999993e-06 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410660+0000", 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047542415999999997 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410703+0000", 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2231000000000003e-05 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410759+0000", 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6271999999999999e-05 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1766 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 364544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.422950876999998, 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868621, 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.852 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1766 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.853 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363124+0000", 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363125+0000", 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.48e-06 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.854 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363129+0000", 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7579999999999998e-06 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363131+0000", 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5320000000000001e-06 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410797+0000", 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047665893000000001 2024-09-18T00:32:29.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410892+0000", 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4406000000000004e-05 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410992+0000", 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100191 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1767 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 393216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.422939548000002, 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047993455999999997, 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1767 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363135+0000", 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0599999999999999e-07 2024-09-18T00:32:29.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363139+0000", 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5249999999999999e-06 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363143+0000", 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3550000000000001e-06 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363145+0000", 2024-09-18T00:32:29.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411022+0000", 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047877292000000002 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411073+0000", 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0528999999999997e-05 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411128+0000", 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4923000000000003e-05 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1768 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.422925562000003, 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048176798, 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.861 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1768 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:29.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364882+0000", 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733917 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364892+0000", 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.577e-06 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.863 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364911+0000", 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8868999999999998e-05 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364917+0000", 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8640000000000001e-06 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411156+0000", 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046238915999999998 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411220+0000", 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4751000000000004e-05 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411325+0000", 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104904 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.865 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1775 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 622592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.421031939999999, 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047673465999999998, 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1775 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365044+0000", 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1200000000000001e-06 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365047+0000", 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.269e-06 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.868 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365049+0000", 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5720000000000001e-06 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412581+0000", 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047531363 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412636+0000", 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4969999999999997e-05 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412716+0000", 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9861e-05 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1776 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.421021559000003, 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047805461, 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.870 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1776 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365053+0000", 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365054+0000", 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0189999999999999e-06 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365057+0000", 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0299999999999998e-06 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365059+0000", 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4619999999999999e-06 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412745+0000", 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047685412000000003 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412795+0000", 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9904000000000002e-05 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412858+0000", 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3406999999999998e-05 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1777 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:29.874 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 37.421011888999999, 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047940417999999999, 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1777 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:29.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366880+0000", 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018183279999999999 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:29.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366884+0000", 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.002e-06 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366896+0000", 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1119e-05 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366905+0000", 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4930000000000004e-06 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:29.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412893+0000", 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045988345999999999 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412947+0000", 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413003+0000", 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5770999999999998e-05 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:29.879 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:29.879 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:32:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:32:29.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:29.886 INFO:teuthology.orchestra.run.smithi081.stdout:3269 write 0x9ac73fe thru 0x9ace9da (0x75dd bytes) 2024-09-18T00:32:29.886 INFO:teuthology.orchestra.run.smithi081.stdout:3270 read 0x43fa2c7 thru 0x43fe153 (0x3e8d bytes) 2024-09-18T00:32:29.887 INFO:teuthology.orchestra.run.smithi081.stdout:3271 trunc from 0x9ace9db to 0x214e9e1 2024-09-18T00:32:29.887 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-18T00:32:29.046821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":921731839,"num_objects":1114,"num_object_clones":278,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":399,"num_read":83790,"num_read_kb":306443,"num_write":10354,"num_write_kb":208428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8649,"ondisk_log_size":8649,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337176,"kb_used_data":32160,"kb_used_omap":12,"kb_used_meta":304819,"kb_avail":754637544,"statfs":{"total":773094113280,"available":772748845056,"internally_reserved":0,"allocated":32931840,"data_stored":328662973,"data_compressed":6667358,"data_compressed_allocated":20480000,"data_compressed_original":322135400,"omap_allocated":12752,"internal_metadata":312135216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":99586362,"num_objects":72,"num_object_clones":3,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":2,"num_read":3180,"num_read_kb":5998,"num_write":713,"num_write_kb":4204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000643"},"pg_stats":[{"pgid":"3.1f","version":"59'164","reported_seq":1841,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034784+0000","last_change":"2024-09-18T00:31:48.867189+0000","last_active":"2024-09-18T00:32:27.034784+0000","last_peered":"2024-09-18T00:32:27.034784+0000","last_clean":"2024-09-18T00:32:27.034784+0000","last_became_active":"2024-09-18T00:31:46.857203+0000","last_became_peered":"2024-09-18T00:31:46.857203+0000","last_unstale":"2024-09-18T00:32:27.034784+0000","last_undegraded":"2024-09-18T00:32:27.034784+0000","last_fullsized":"2024-09-18T00:32:27.034784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:16:05.851553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011431729999999999,"stat_sum":{"num_bytes":25832432,"num_objects":38,"num_object_clones":11,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":15,"num_read":1823,"num_read_kb":18665,"num_write":156,"num_write_kb":9081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"54'416","reported_seq":1458,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026611+0000","last_change":"2024-09-18T00:31:48.986506+0000","last_active":"2024-09-18T00:32:24.026611+0000","last_peered":"2024-09-18T00:32:24.026611+0000","last_clean":"2024-09-18T00:32:24.026611+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:32:24.026611+0000","last_undegraded":"2024-09-18T00:32:24.026611+0000","last_fullsized":"2024-09-18T00:32:24.026611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:58:32.661954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078236600000000005,"stat_sum":{"num_bytes":15656719,"num_objects":33,"num_object_clones":8,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":2649,"num_read_kb":19882,"num_write":678,"num_write_kb":12085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"57'204","reported_seq":2312,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020694+0000","last_change":"2024-09-18T00:31:48.858463+0000","last_active":"2024-09-18T00:32:25.020694+0000","last_peered":"2024-09-18T00:32:25.020694+0000","last_clean":"2024-09-18T00:32:25.020694+0000","last_became_active":"2024-09-18T00:31:46.855003+0000","last_became_peered":"2024-09-18T00:31:46.855003+0000","last_unstale":"2024-09-18T00:32:25.020694+0000","last_undegraded":"2024-09-18T00:32:25.020694+0000","last_fullsized":"2024-09-18T00:32:25.020694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:23.919981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048435299999999998,"stat_sum":{"num_bytes":45828419,"num_objects":47,"num_object_clones":10,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":14,"num_read":2520,"num_read_kb":30889,"num_write":200,"num_write_kb":17277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"58'454","reported_seq":3388,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.063931+0000","last_change":"2024-09-18T00:31:48.858226+0000","last_active":"2024-09-18T00:32:25.063931+0000","last_peered":"2024-09-18T00:32:25.063931+0000","last_clean":"2024-09-18T00:32:25.063931+0000","last_became_active":"2024-09-18T00:31:46.854720+0000","last_became_peered":"2024-09-18T00:31:46.854720+0000","last_unstale":"2024-09-18T00:32:25.063931+0000","last_undegraded":"2024-09-18T00:32:25.063931+0000","last_fullsized":"2024-09-18T00:32:25.063931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:43.911277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039719499999999998,"stat_sum":{"num_bytes":100074887,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":3984,"num_read_kb":5540,"num_write":584,"num_write_kb":9943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"59'554","reported_seq":1870,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034889+0000","last_change":"2024-09-18T00:31:48.867301+0000","last_active":"2024-09-18T00:32:27.034889+0000","last_peered":"2024-09-18T00:32:27.034889+0000","last_clean":"2024-09-18T00:32:27.034889+0000","last_became_active":"2024-09-18T00:31:46.859322+0000","last_became_peered":"2024-09-18T00:31:46.859322+0000","last_unstale":"2024-09-18T00:32:27.034889+0000","last_undegraded":"2024-09-18T00:32:27.034889+0000","last_fullsized":"2024-09-18T00:32:27.034889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:18.008639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012412110000000001,"stat_sum":{"num_bytes":12405012,"num_objects":32,"num_object_clones":6,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":3538,"num_read_kb":3915,"num_write":890,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"56'177","reported_seq":3054,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.055669+0000","last_change":"2024-09-18T00:31:48.860421+0000","last_active":"2024-09-18T00:32:25.055669+0000","last_peered":"2024-09-18T00:32:25.055669+0000","last_clean":"2024-09-18T00:32:25.055669+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:32:25.055669+0000","last_undegraded":"2024-09-18T00:32:25.055669+0000","last_fullsized":"2024-09-18T00:32:25.055669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:27.435565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089020699999999996,"stat_sum":{"num_bytes":77444124,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":3110,"num_read_kb":18193,"num_write":173,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"58'268","reported_seq":876,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.067301+0000","last_change":"2024-09-18T00:31:48.856023+0000","last_active":"2024-09-18T00:32:25.067301+0000","last_peered":"2024-09-18T00:32:25.067301+0000","last_clean":"2024-09-18T00:32:25.067301+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:32:25.067301+0000","last_undegraded":"2024-09-18T00:32:25.067301+0000","last_fullsized":"2024-09-18T00:32:25.067301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:23:07.491381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050127899999999998,"stat_sum":{"num_bytes":14983899,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":1481,"num_read_kb":1654,"num_write":337,"num_write_kb":1426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"55'182","reported_seq":2047,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026306+0000","last_change":"2024-09-18T00:31:48.986343+0000","last_active":"2024-09-18T00:32:24.026306+0000","last_peered":"2024-09-18T00:32:24.026306+0000","last_clean":"2024-09-18T00:32:24.026306+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:32:24.026306+0000","last_undegraded":"2024-09-18T00:32:24.026306+0000","last_fullsized":"2024-09-18T00:32:24.026306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:40.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065419800000000004,"stat_sum":{"num_bytes":10303540,"num_objects":32,"num_object_clones":10,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":2358,"num_read_kb":3861,"num_write":168,"num_write_kb":1986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"59'177","reported_seq":906,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034850+0000","last_change":"2024-09-18T00:31:48.867375+0000","last_active":"2024-09-18T00:32:27.034850+0000","last_peered":"2024-09-18T00:32:27.034850+0000","last_clean":"2024-09-18T00:32:27.034850+0000","last_became_active":"2024-09-18T00:31:46.858297+0000","last_became_peered":"2024-09-18T00:31:46.858297+0000","last_unstale":"2024-09-18T00:32:27.034850+0000","last_undegraded":"2024-09-18T00:32:27.034850+0000","last_fullsized":"2024-09-18T00:32:27.034850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:56:03.694174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012184100000000001,"stat_sum":{"num_bytes":24190222,"num_objects":28,"num_object_clones":7,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":8,"num_read":1039,"num_read_kb":1734,"num_write":216,"num_write_kb":1155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"56'263","reported_seq":1565,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020462+0000","last_change":"2024-09-18T00:31:48.858308+0000","last_active":"2024-09-18T00:32:25.020462+0000","last_peered":"2024-09-18T00:32:25.020462+0000","last_clean":"2024-09-18T00:32:25.020462+0000","last_became_active":"2024-09-18T00:31:46.851617+0000","last_became_peered":"2024-09-18T00:31:46.851617+0000","last_unstale":"2024-09-18T00:32:25.020462+0000","last_undegraded":"2024-09-18T00:32:25.020462+0000","last_fullsized":"2024-09-18T00:32:25.020462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:30.122009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035842399999999998,"stat_sum":{"num_bytes":13308343,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":16,"num_read":2511,"num_read_kb":3640,"num_write":294,"num_write_kb":1327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"57'173","reported_seq":1544,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051538+0000","last_change":"2024-09-18T00:31:48.871844+0000","last_active":"2024-09-18T00:32:25.051538+0000","last_peered":"2024-09-18T00:32:25.051538+0000","last_clean":"2024-09-18T00:32:25.051538+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:32:25.051538+0000","last_undegraded":"2024-09-18T00:32:25.051538+0000","last_fullsized":"2024-09-18T00:32:25.051538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:09.524168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037964800000000001,"stat_sum":{"num_bytes":39660049,"num_objects":29,"num_object_clones":5,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":13,"num_read":1357,"num_read_kb":2379,"num_write":159,"num_write_kb":1995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"58'172","reported_seq":2167,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.029743+0000","last_change":"2024-09-18T00:31:48.860473+0000","last_active":"2024-09-18T00:32:25.029743+0000","last_peered":"2024-09-18T00:32:25.029743+0000","last_clean":"2024-09-18T00:32:25.029743+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:32:25.029743+0000","last_undegraded":"2024-09-18T00:32:25.029743+0000","last_fullsized":"2024-09-18T00:32:25.029743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:02:54.524614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090479700000000004,"stat_sum":{"num_bytes":33320578,"num_objects":35,"num_object_clones":11,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":1973,"num_read_kb":19489,"num_write":170,"num_write_kb":16993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.047893+0000","last_change":"2024-09-18T00:31:39.548951+0000","last_active":"2024-09-18T00:32:24.047893+0000","last_peered":"2024-09-18T00:32:24.047893+0000","last_clean":"2024-09-18T00:32:24.047893+0000","last_became_active":"2024-09-18T00:31:37.149568+0000","last_became_peered":"2024-09-18T00:31:37.149568+0000","last_unstale":"2024-09-18T00:32:24.047893+0000","last_undegraded":"2024-09-18T00:32:24.047893+0000","last_fullsized":"2024-09-18T00:32:24.047893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:42:56.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000409918,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"59'160","reported_seq":1090,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034849+0000","last_change":"2024-09-18T00:31:48.867043+0000","last_active":"2024-09-18T00:32:27.034849+0000","last_peered":"2024-09-18T00:32:27.034849+0000","last_clean":"2024-09-18T00:32:27.034849+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:32:27.034849+0000","last_undegraded":"2024-09-18T00:32:27.034849+0000","last_fullsized":"2024-09-18T00:32:27.034849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:40:39.831486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010540840000000001,"stat_sum":{"num_bytes":6292737,"num_objects":26,"num_object_clones":8,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":1011,"num_read_kb":2230,"num_write":175,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020599+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:32:25.020599+0000","last_peered":"2024-09-18T00:32:25.020599+0000","last_clean":"2024-09-18T00:32:25.020599+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:32:25.020599+0000","last_undegraded":"2024-09-18T00:32:25.020599+0000","last_fullsized":"2024-09-18T00:32:25.020599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"56'269","reported_seq":2269,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026585+0000","last_change":"2024-09-18T00:31:48.986721+0000","last_active":"2024-09-18T00:32:24.026585+0000","last_peered":"2024-09-18T00:32:24.026585+0000","last_clean":"2024-09-18T00:32:24.026585+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:32:24.026585+0000","last_undegraded":"2024-09-18T00:32:24.026585+0000","last_fullsized":"2024-09-18T00:32:24.026585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:19:38.825780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094052899999999995,"stat_sum":{"num_bytes":2817336,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":13,"num_read":2533,"num_read_kb":1696,"num_write":338,"num_write_kb":7489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051643+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:32:25.051643+0000","last_peered":"2024-09-18T00:32:25.051643+0000","last_clean":"2024-09-18T00:32:25.051643+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:32:25.051643+0000","last_undegraded":"2024-09-18T00:32:25.051643+0000","last_fullsized":"2024-09-18T00:32:25.051643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'280","reported_seq":1858,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020418+0000","last_change":"2024-09-18T00:31:48.855715+0000","last_active":"2024-09-18T00:32:25.020418+0000","last_peered":"2024-09-18T00:32:25.020418+0000","last_clean":"2024-09-18T00:32:25.020418+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:32:25.020418+0000","last_undegraded":"2024-09-18T00:32:25.020418+0000","last_fullsized":"2024-09-18T00:32:25.020418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:14.275967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028487899999999998,"stat_sum":{"num_bytes":70492359,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":2158,"num_read_kb":4498,"num_write":280,"num_write_kb":2479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020528+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:32:25.020528+0000","last_peered":"2024-09-18T00:32:25.020528+0000","last_clean":"2024-09-18T00:32:25.020528+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:32:25.020528+0000","last_undegraded":"2024-09-18T00:32:25.020528+0000","last_fullsized":"2024-09-18T00:32:25.020528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"57'507","reported_seq":1521,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020586+0000","last_change":"2024-09-18T00:31:48.858535+0000","last_active":"2024-09-18T00:32:25.020586+0000","last_peered":"2024-09-18T00:32:25.020586+0000","last_clean":"2024-09-18T00:32:25.020586+0000","last_became_active":"2024-09-18T00:31:46.852261+0000","last_became_peered":"2024-09-18T00:31:46.852261+0000","last_unstale":"2024-09-18T00:32:25.020586+0000","last_undegraded":"2024-09-18T00:32:25.020586+0000","last_fullsized":"2024-09-18T00:32:25.020586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:11.483068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053830299999999996,"stat_sum":{"num_bytes":41158459,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":14,"num_read":2743,"num_read_kb":4036,"num_write":732,"num_write_kb":1512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"56'123","reported_seq":643,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.029637+0000","last_change":"2024-09-18T00:31:48.860661+0000","last_active":"2024-09-18T00:32:25.029637+0000","last_peered":"2024-09-18T00:32:25.029637+0000","last_clean":"2024-09-18T00:32:25.029637+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:32:25.029637+0000","last_undegraded":"2024-09-18T00:32:25.029637+0000","last_fullsized":"2024-09-18T00:32:25.029637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:05.510256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094755499999999999,"stat_sum":{"num_bytes":13605405,"num_objects":22,"num_object_clones":4,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":12,"num_read":466,"num_read_kb":1613,"num_write":111,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":95,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020310+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:32:25.020310+0000","last_peered":"2024-09-18T00:32:25.020310+0000","last_clean":"2024-09-18T00:32:25.020310+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:32:25.020310+0000","last_undegraded":"2024-09-18T00:32:25.020310+0000","last_fullsized":"2024-09-18T00:32:25.020310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"56'199","reported_seq":1131,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020366+0000","last_change":"2024-09-18T00:31:48.855777+0000","last_active":"2024-09-18T00:32:25.020366+0000","last_peered":"2024-09-18T00:32:25.020366+0000","last_clean":"2024-09-18T00:32:25.020366+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:32:25.020366+0000","last_undegraded":"2024-09-18T00:32:25.020366+0000","last_fullsized":"2024-09-18T00:32:25.020366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:13:55.167995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032180899999999999,"stat_sum":{"num_bytes":24407438,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":915,"num_read_kb":2398,"num_write":168,"num_write_kb":8381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.015762+0000","last_change":"2024-09-18T00:31:39.548973+0000","last_active":"2024-09-18T00:32:24.015762+0000","last_peered":"2024-09-18T00:32:24.015762+0000","last_clean":"2024-09-18T00:32:24.015762+0000","last_became_active":"2024-09-18T00:31:37.518412+0000","last_became_peered":"2024-09-18T00:31:37.518412+0000","last_unstale":"2024-09-18T00:32:24.015762+0000","last_undegraded":"2024-09-18T00:32:24.015762+0000","last_fullsized":"2024-09-18T00:32:24.015762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:00.916304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000355072,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'147","reported_seq":4550,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034628+0000","last_change":"2024-09-18T00:31:48.866306+0000","last_active":"2024-09-18T00:32:27.034628+0000","last_peered":"2024-09-18T00:32:27.034628+0000","last_clean":"2024-09-18T00:32:27.034628+0000","last_became_active":"2024-09-18T00:31:46.858165+0000","last_became_peered":"2024-09-18T00:31:46.858165+0000","last_unstale":"2024-09-18T00:32:27.034628+0000","last_undegraded":"2024-09-18T00:32:27.034628+0000","last_fullsized":"2024-09-18T00:32:27.034628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:44.704161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054274200000000003,"stat_sum":{"num_bytes":30547303,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":11,"num_read":4397,"num_read_kb":20760,"num_write":144,"num_write_kb":8164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051352+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:32:25.051352+0000","last_peered":"2024-09-18T00:32:25.051352+0000","last_clean":"2024-09-18T00:32:25.051352+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:32:25.051352+0000","last_undegraded":"2024-09-18T00:32:25.051352+0000","last_fullsized":"2024-09-18T00:32:25.051352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"57'150","reported_seq":2146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.061633+0000","last_change":"2024-09-18T00:31:48.985967+0000","last_active":"2024-09-18T00:32:24.061633+0000","last_peered":"2024-09-18T00:32:24.061633+0000","last_clean":"2024-09-18T00:32:24.061633+0000","last_became_active":"2024-09-18T00:31:46.853986+0000","last_became_peered":"2024-09-18T00:31:46.853986+0000","last_unstale":"2024-09-18T00:32:24.061633+0000","last_undegraded":"2024-09-18T00:32:24.061633+0000","last_fullsized":"2024-09-18T00:32:24.061633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:29:17.561598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043793499999999997,"stat_sum":{"num_bytes":25684339,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":1991,"num_read_kb":19296,"num_write":149,"num_write_kb":15083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":94,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020324+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:32:25.020324+0000","last_peered":"2024-09-18T00:32:25.020324+0000","last_clean":"2024-09-18T00:32:25.020324+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:32:25.020324+0000","last_undegraded":"2024-09-18T00:32:25.020324+0000","last_fullsized":"2024-09-18T00:32:25.020324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051363+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:32:25.051363+0000","last_peered":"2024-09-18T00:32:25.051363+0000","last_clean":"2024-09-18T00:32:25.051363+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:32:25.051363+0000","last_undegraded":"2024-09-18T00:32:25.051363+0000","last_fullsized":"2024-09-18T00:32:25.051363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"54'280","reported_seq":3320,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026312+0000","last_change":"2024-09-18T00:31:48.986780+0000","last_active":"2024-09-18T00:32:24.026312+0000","last_peered":"2024-09-18T00:32:24.026312+0000","last_clean":"2024-09-18T00:32:24.026312+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:32:24.026312+0000","last_undegraded":"2024-09-18T00:32:24.026312+0000","last_fullsized":"2024-09-18T00:32:24.026312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:31:43.140520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092255199999999999,"stat_sum":{"num_bytes":11262425,"num_objects":27,"num_object_clones":4,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":5269,"num_read_kb":6526,"num_write":272,"num_write_kb":1013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"58'227","reported_seq":3956,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.047346+0000","last_change":"2024-09-18T00:31:48.859894+0000","last_active":"2024-09-18T00:32:25.047346+0000","last_peered":"2024-09-18T00:32:25.047346+0000","last_clean":"2024-09-18T00:32:25.047346+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:32:25.047346+0000","last_undegraded":"2024-09-18T00:32:25.047346+0000","last_fullsized":"2024-09-18T00:32:25.047346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:40.017683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037794800000000002,"stat_sum":{"num_bytes":36512384,"num_objects":38,"num_object_clones":11,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":4760,"num_read_kb":9891,"num_write":213,"num_write_kb":2569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"57'153","reported_seq":2483,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.063982+0000","last_change":"2024-09-18T00:31:48.985698+0000","last_active":"2024-09-18T00:32:24.063982+0000","last_peered":"2024-09-18T00:32:24.063982+0000","last_clean":"2024-09-18T00:32:24.063982+0000","last_became_active":"2024-09-18T00:31:46.855822+0000","last_became_peered":"2024-09-18T00:31:46.855822+0000","last_unstale":"2024-09-18T00:32:24.063982+0000","last_undegraded":"2024-09-18T00:32:24.063982+0000","last_fullsized":"2024-09-18T00:32:24.063982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:48.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030723799999999999,"stat_sum":{"num_bytes":5595702,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":14,"num_read":2772,"num_read_kb":2919,"num_write":138,"num_write_kb":813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"56'238","reported_seq":1004,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.026351+0000","last_change":"2024-09-18T00:31:48.986238+0000","last_active":"2024-09-18T00:32:24.026351+0000","last_peered":"2024-09-18T00:32:24.026351+0000","last_clean":"2024-09-18T00:32:24.026351+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:32:24.026351+0000","last_undegraded":"2024-09-18T00:32:24.026351+0000","last_fullsized":"2024-09-18T00:32:24.026351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:45:08.514746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063642199999999999,"stat_sum":{"num_bytes":19606156,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":18,"num_read":1104,"num_read_kb":3473,"num_write":250,"num_write_kb":9893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"55'147","reported_seq":1167,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.020483+0000","last_change":"2024-09-18T00:31:48.858730+0000","last_active":"2024-09-18T00:32:25.020483+0000","last_peered":"2024-09-18T00:32:25.020483+0000","last_clean":"2024-09-18T00:32:25.020483+0000","last_became_active":"2024-09-18T00:31:46.851057+0000","last_became_peered":"2024-09-18T00:31:46.851057+0000","last_unstale":"2024-09-18T00:32:25.020483+0000","last_undegraded":"2024-09-18T00:32:25.020483+0000","last_fullsized":"2024-09-18T00:32:25.020483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:47.077748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069353299999999998,"stat_sum":{"num_bytes":13708247,"num_objects":31,"num_object_clones":7,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":15,"num_read":975,"num_read_kb":2512,"num_write":130,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"54'328","reported_seq":3546,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051556+0000","last_change":"2024-09-18T00:31:48.872219+0000","last_active":"2024-09-18T00:32:25.051556+0000","last_peered":"2024-09-18T00:32:25.051556+0000","last_clean":"2024-09-18T00:32:25.051556+0000","last_became_active":"2024-09-18T00:31:46.853922+0000","last_became_peered":"2024-09-18T00:31:46.853922+0000","last_unstale":"2024-09-18T00:32:25.051556+0000","last_undegraded":"2024-09-18T00:32:25.051556+0000","last_fullsized":"2024-09-18T00:32:25.051556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:39:03.731596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063734100000000004,"stat_sum":{"num_bytes":55229265,"num_objects":45,"num_object_clones":14,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":16,"num_read":5221,"num_read_kb":6454,"num_write":343,"num_write_kb":1907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"55'493","reported_seq":3914,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051670+0000","last_change":"2024-09-18T00:31:48.871997+0000","last_active":"2024-09-18T00:32:25.051670+0000","last_peered":"2024-09-18T00:32:25.051670+0000","last_clean":"2024-09-18T00:32:25.051670+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:32:25.051670+0000","last_undegraded":"2024-09-18T00:32:25.051670+0000","last_fullsized":"2024-09-18T00:32:25.051670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:36.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052206099999999999,"stat_sum":{"num_bytes":18050580,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":5847,"num_read_kb":8737,"num_write":616,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"56'148","reported_seq":2088,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051603+0000","last_change":"2024-09-18T00:31:48.872116+0000","last_active":"2024-09-18T00:32:25.051603+0000","last_peered":"2024-09-18T00:32:25.051603+0000","last_clean":"2024-09-18T00:32:25.051603+0000","last_became_active":"2024-09-18T00:31:46.858825+0000","last_became_peered":"2024-09-18T00:31:46.858825+0000","last_unstale":"2024-09-18T00:32:25.051603+0000","last_undegraded":"2024-09-18T00:32:25.051603+0000","last_fullsized":"2024-09-18T00:32:25.051603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:21:16.321649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057934999999999996,"stat_sum":{"num_bytes":11522202,"num_objects":37,"num_object_clones":8,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":16,"num_read":2202,"num_read_kb":2377,"num_write":127,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"57'182","reported_seq":1825,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-18T00:32:24.245558+0000","last_change":"2024-09-18T00:31:48.985662+0000","last_active":"2024-09-18T00:32:24.245558+0000","last_peered":"2024-09-18T00:32:24.245558+0000","last_clean":"2024-09-18T00:32:24.245558+0000","last_became_active":"2024-09-18T00:31:46.856661+0000","last_became_peered":"2024-09-18T00:31:46.856661+0000","last_unstale":"2024-09-18T00:32:24.245558+0000","last_undegraded":"2024-09-18T00:32:24.245558+0000","last_fullsized":"2024-09-18T00:32:24.245558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:48:20.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027370699999999999,"stat_sum":{"num_bytes":11637646,"num_objects":37,"num_object_clones":13,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":1637,"num_read_kb":5018,"num_write":161,"num_write_kb":9616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"57'867","reported_seq":2336,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.056254+0000","last_change":"2024-09-18T00:32:01.924094+0000","last_active":"2024-09-18T00:32:25.056254+0000","last_peered":"2024-09-18T00:32:25.056254+0000","last_clean":"2024-09-18T00:32:25.056254+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:32:25.056254+0000","last_undegraded":"2024-09-18T00:32:25.056254+0000","last_fullsized":"2024-09-18T00:32:25.056254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:11:46.445036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035443699999999998,"stat_sum":{"num_bytes":31054303,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":11,"num_read":6118,"num_read_kb":20612,"num_write":1426,"num_write_kb":9754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"57'256","reported_seq":1906,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T00:32:27.034688+0000","last_change":"2024-09-18T00:31:48.866261+0000","last_active":"2024-09-18T00:32:27.034688+0000","last_peered":"2024-09-18T00:32:27.034688+0000","last_clean":"2024-09-18T00:32:27.034688+0000","last_became_active":"2024-09-18T00:31:46.858545+0000","last_became_peered":"2024-09-18T00:31:46.858545+0000","last_unstale":"2024-09-18T00:32:27.034688+0000","last_undegraded":"2024-09-18T00:32:27.034688+0000","last_fullsized":"2024-09-18T00:32:27.034688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:41:24.153047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047466899999999999,"stat_sum":{"num_bytes":61930739,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":2221,"num_read_kb":48661,"num_write":231,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"54'171","reported_seq":1167,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T00:32:25.051452+0000","last_change":"2024-09-18T00:31:48.872343+0000","last_active":"2024-09-18T00:32:25.051452+0000","last_peered":"2024-09-18T00:32:25.051452+0000","last_clean":"2024-09-18T00:32:25.051452+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:32:25.051452+0000","last_undegraded":"2024-09-18T00:32:25.051452+0000","last_fullsized":"2024-09-18T00:32:25.051452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:08:05.251506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066573000000000001,"stat_sum":{"num_bytes":17018203,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":991,"num_read_kb":2795,"num_write":164,"num_write_kb":1858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":921141452,"num_objects":1110,"num_object_clones":278,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1110,"num_whiteouts":399,"num_read":83674,"num_read_kb":306343,"num_write":10193,"num_write_kb":206010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28614656,"data_stored":326565779,"data_compressed":7192273,"data_compressed_allocated":21041152,"data_compressed_original":322213224,"omap_allocated":0,"internal_metadata":0},"log_size":8529,"ondisk_log_size":8529,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45096,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326744,"statfs":{"total":96636764160,"available":96590585856,"internally_reserved":0,"allocated":5718016,"data_stored":65877992,"data_compressed":1154795,"data_compressed_allocated":3932160,"data_compressed_original":64890447,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1794048,"data_stored":13271720,"data_compressed":130953,"data_compressed_allocated":884736,"data_compressed_original":12838912,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40352,"kb_used_data":5000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331488,"statfs":{"total":96636764160,"available":96595443712,"internally_reserved":0,"allocated":5120000,"data_stored":47829715,"data_compressed":1213506,"data_compressed_allocated":3366912,"data_compressed_original":46913416,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63920,"kb_used_data":6356,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307920,"statfs":{"total":96636764160,"available":96571310080,"internally_reserved":0,"allocated":6508544,"data_stored":85055869,"data_compressed":1213275,"data_compressed_allocated":4419584,"data_compressed_original":83904640,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37880,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333960,"statfs":{"total":96636764160,"available":96597975040,"internally_reserved":0,"allocated":2592768,"data_stored":20249544,"data_compressed":673202,"data_compressed_allocated":1249280,"data_compressed_original":19580933,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43116,"kb_used_data":3612,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328724,"statfs":{"total":96636764160,"available":96592613376,"internally_reserved":0,"allocated":3698688,"data_stored":25096981,"data_compressed":679619,"data_compressed_allocated":2056192,"data_compressed_original":24255704,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1716224,"data_stored":6416331,"data_compressed":484123,"data_compressed_allocated":679936,"data_compressed_original":5896192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40996,"kb_used_data":5648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330844,"statfs":{"total":96636764160,"available":96594784256,"internally_reserved":0,"allocated":5783552,"data_stored":64864821,"data_compressed":1117885,"data_compressed_allocated":3891200,"data_compressed_original":63855156,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5296128,"data_stored":64388544,"data_compressed":1217967,"data_compressed_allocated":3989504,"data_compressed_original":63650356,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1941504,"data_stored":19960578,"data_compressed":673202,"data_compressed_allocated":1249280,"data_compressed_original":19580933,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1077248,"data_stored":6133519,"data_compressed":484123,"data_compressed_allocated":679936,"data_compressed_original":5896192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3059712,"data_stored":24814169,"data_compressed":679619,"data_compressed_allocated":2056192,"data_compressed_original":24255704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":85233895,"data_compressed":1417928,"data_compressed_allocated":4657152,"data_compressed_original":84310144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4571136,"data_stored":47670380,"data_compressed":1277461,"data_compressed_allocated":3440640,"data_compressed_original":47028104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1142784,"data_stored":12982757,"data_compressed":130953,"data_compressed_allocated":884736,"data_compressed_original":12838912,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":65381937,"data_compressed":1311020,"data_compressed_allocated":4083712,"data_compressed_original":64652879,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:32:29.889 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T00:32:29.890 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:29.890 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-18T00:32:29.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T00:32:29.891 INFO:teuthology.orchestra.run.smithi081.stdout:3272 writesame 0xd7153a6 thru 0xd71f20e data_size 0x1(0x9e69 bytes) 2024-09-18T00:32:29.891 INFO:teuthology.orchestra.run.smithi081.stdout:3273 punch from 0xc1112d9 to 0xc11fa37, (0xe75e bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3275 writesame 0xc67d468 thru 0xc68bbb5 data_size 0x8e(0xe74e bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3276 read 0x57b8945 thru 0x57c3f77 (0xb633 bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3277 read 0x4c6babb thru 0x4c6ea88 (0x2fce bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3279 trunc from 0xd71f20f to 0x3c4203f 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3281 read 0xbad55d thru 0xbb3635 (0x60d9 bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3282 read 0x2d7dd5d thru 0x2d7ea93 (0xd37 bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3286 writesame 0x75f0d0 thru 0x76cdce data_size 0x49(0xdcff bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3289 punch from 0x31b684a to 0x31c48e5, (0xe09b bytes) 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.892 INFO:teuthology.orchestra.run.smithi081.stdout:3293 trunc from 0x3c4203f to 0x3a23fd7 2024-09-18T00:32:29.893 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:29.878+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:29.893 INFO:teuthology.orchestra.run.smithi081.stdout:3294 writesame 0xa3eb3e6 thru 0xa3ed8e6 data_size 0x1(0x2501 bytes) 2024-09-18T00:32:29.893 INFO:teuthology.orchestra.run.smithi081.stdout:3295 read 0x2cd3372 thru 0x2ce1f4f (0xebde bytes) 2024-09-18T00:32:29.894 INFO:teuthology.orchestra.run.smithi081.stdout:3296 writesame 0x632ef8c thru 0x633c6f0 data_size 0x1(0xd765 bytes) 2024-09-18T00:32:29.915 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.915 INFO:teuthology.orchestra.run.smithi081.stdout:3300 read 0x59723f0 thru 0x5973e0b (0x1a1c bytes) 2024-09-18T00:32:29.917 INFO:teuthology.orchestra.run.smithi081.stdout:3302 read 0x36a69d8 thru 0x36b3df4 (0xd41d bytes) 2024-09-18T00:32:29.921 INFO:teuthology.orchestra.run.smithi081.stdout:3303 trunc from 0xa3ed8e7 to 0xd8b0ac8 2024-09-18T00:32:29.927 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.927 INFO:teuthology.orchestra.run.smithi081.stdout:3305 write 0x5a0d3ba thru 0x5a117a6 (0x43ed bytes) 2024-09-18T00:32:29.930 INFO:teuthology.orchestra.run.smithi081.stdout:3306 writesame 0x1d007a9 thru 0x1d0dc08 data_size 0x10(0xd460 bytes) 2024-09-18T00:32:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:3308 read 0x9064271 thru 0x906e315 (0xa0a5 bytes) 2024-09-18T00:32:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:3310 punch from 0xc345a3a to 0xc34f2e7, (0x98ad bytes) 2024-09-18T00:32:29.948 INFO:teuthology.orchestra.run.smithi081.stdout:3311 trunc from 0xd8b0ac8 to 0x23fe8e8 2024-09-18T00:32:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:3313 punch from 0x313fb5 to 0x322fff, (0xf04a bytes) 2024-09-18T00:32:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:3315 punch from 0x126f7e8 to 0x1279d5e, (0xa576 bytes) 2024-09-18T00:32:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:3317 read 0x29e3b3 thru 0x2a1a4c (0x369a bytes) 2024-09-18T00:32:29.966 INFO:teuthology.orchestra.run.smithi081.stdout:3318 trunc from 0x23fe8e8 to 0x1267db5 2024-09-18T00:32:29.975 INFO:teuthology.orchestra.run.smithi081.stdout:3319 read 0x1061bac thru 0x10677ac (0x5c01 bytes) 2024-09-18T00:32:29.975 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.976 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:29.976 INFO:teuthology.orchestra.run.smithi081.stdout:3322 read 0xe1a44a thru 0xe20a5b (0x6612 bytes) 2024-09-18T00:32:29.981 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:29.979+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:29.999 INFO:teuthology.orchestra.run.smithi081.stdout:3324 write 0xe0cf47b thru 0xe0d399f (0x4525 bytes) 2024-09-18T00:32:30.003 INFO:teuthology.orchestra.run.smithi081.stdout:3326 write 0x798cee3 thru 0x7999be1 (0xccff bytes) 2024-09-18T00:32:30.007 INFO:teuthology.orchestra.run.smithi081.stdout:3327 read 0x2db9d7c thru 0x2dc1fe4 (0x8269 bytes) 2024-09-18T00:32:30.020 INFO:teuthology.orchestra.run.smithi081.stdout:3329 trunc from 0xe0d39a0 to 0x353cf66 2024-09-18T00:32:30.032 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:30.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.040 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:30.052 INFO:teuthology.orchestra.run.smithi081.stdout:3331 trunc from 0x353cf66 to 0xd5b757e 2024-09-18T00:32:30.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:32:30.058 INFO:teuthology.orchestra.run.smithi081.stdout:3332 write 0x8749020 thru 0x874b592 (0x2573 bytes) 2024-09-18T00:32:30.061 INFO:teuthology.orchestra.run.smithi081.stdout:3333 writesame 0x78fc07c thru 0x790b7c2 data_size 0x1(0xf747 bytes) 2024-09-18T00:32:30.082 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:30.080+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:30.101 INFO:teuthology.orchestra.run.smithi081.stdout:3335 punch from 0x5718c7e to 0x5726a7a, (0xddfc bytes) 2024-09-18T00:32:30.101 INFO:teuthology.orchestra.run.smithi081.stdout:3336 read 0x6938d7f thru 0x6945d52 (0xcfd4 bytes) 2024-09-18T00:32:30.103 INFO:teuthology.orchestra.run.smithi081.stdout:3338 read 0x4b1c4a9 thru 0x4b20119 (0x3c71 bytes) 2024-09-18T00:32:30.104 INFO:teuthology.orchestra.run.smithi081.stdout:3339 writesame 0x2815407 thru 0x281dbc4 data_size 0x32(0x87be bytes) 2024-09-18T00:32:30.106 INFO:teuthology.orchestra.run.smithi081.stdout:3340 punch from 0x4d305c3 to 0x4d3ed67, (0xe7a4 bytes) 2024-09-18T00:32:30.106 INFO:teuthology.orchestra.run.smithi081.stdout:3341 read 0x9636da2 thru 0x964698f (0xfbee bytes) 2024-09-18T00:32:30.106 INFO:teuthology.orchestra.run.smithi081.stdout:3342 write 0xcef9a12 thru 0xcefd444 (0x3a33 bytes) 2024-09-18T00:32:30.109 INFO:teuthology.orchestra.run.smithi081.stdout:3343 write 0x14fe6fd thru 0x150653c (0x7e40 bytes) 2024-09-18T00:32:30.114 INFO:teuthology.orchestra.run.smithi081.stdout:3344 read 0xb82db61 thru 0xb8318db (0x3d7b bytes) 2024-09-18T00:32:30.114 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.114 INFO:teuthology.orchestra.run.smithi081.stdout:3347 punch from 0x1269618 to 0x126bfcf, (0x29b7 bytes) 2024-09-18T00:32:30.128 INFO:teuthology.orchestra.run.smithi081.stdout:3348 trunc from 0xd5b757e to 0x302b094 2024-09-18T00:32:30.165 INFO:teuthology.orchestra.run.smithi081.stdout:3349 write 0x81b2270 thru 0x81be932 (0xc6c3 bytes) 2024-09-18T00:32:30.167 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:30.168 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.168 INFO:teuthology.orchestra.run.smithi081.stdout:3351 write 0x2c81181 thru 0x2c87d5b (0x6bdb bytes) 2024-09-18T00:32:30.175 INFO:teuthology.orchestra.run.smithi081.stdout:3353 write 0x8371c4c thru 0x837e9cd (0xcd82 bytes) 2024-09-18T00:32:30.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:30.178 INFO:teuthology.orchestra.run.smithi081.stdout:3357 punch from 0x55344fd to 0x55425ae, (0xe0b1 bytes) 2024-09-18T00:32:30.187 INFO:teuthology.orchestra.run.smithi081.stdout:3359 trunc from 0x837e9ce to 0x51b9a3 2024-09-18T00:32:30.188 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:30.186+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:30.212 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.212 INFO:teuthology.orchestra.run.smithi081.stdout:3361 read 0x320faf thru 0x330056 (0xf0a8 bytes) 2024-09-18T00:32:30.222 INFO:teuthology.orchestra.run.smithi081.stdout:3362 trunc from 0x51b9a3 to 0x787302e 2024-09-18T00:32:30.229 INFO:teuthology.orchestra.run.smithi081.stdout:3364 read 0x610e01d thru 0x6114d8c (0x6d70 bytes) 2024-09-18T00:32:30.229 INFO:teuthology.orchestra.run.smithi081.stdout:3365 punch from 0x339f686 to 0x33a111e, (0x1a98 bytes) 2024-09-18T00:32:30.237 INFO:teuthology.orchestra.run.smithi081.stdout:3366 write 0x8eb32f4 thru 0x8ebbb48 (0x8855 bytes) 2024-09-18T00:32:30.240 INFO:teuthology.orchestra.run.smithi081.stdout:3367 writesame 0x1653d60 thru 0x16599ad data_size 0x22(0x5c4e bytes) 2024-09-18T00:32:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:32:30.243 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 62, 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "1111294f-f881-4427-a507-2f6f0939f89f", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-18T00:31:16.967705+0000", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-18T00:32:29.043078+0000", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-18T00:31:29.069471+0000", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-18T00:31:19.984105+0000", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5804032, 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nodeep-scrub", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-18T00:32:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 6, 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-18T00:32:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "squid", 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:29.068996+0000", 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "17", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 8, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.25, 2024-09-18T00:32:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:35.737341+0000", 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:32:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-18T00:32:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "21", 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 2, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 21, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.9900000095367432, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.9900000095367432, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.75, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.75, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-18T00:32:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:45.237398+0000", 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "62", 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 29, 2024-09-18T00:32:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 62, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.5, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.5, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.5, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.5, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:32:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "f3f5415f-ac86-4dd6-8c50-5391b44b9c6b", 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6803/2689107883", 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/2689107883", 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6809/2689107883", 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6807/2689107883", 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "06a47ef1-1ae7-40a2-a998-daac122fc229", 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-18T00:32:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6813/1726163291", 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6817/1726163291", 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6825/1726163291", 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6821/1726163291", 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "653ab61a-1037-4190-8806-7042ef3d0586", 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 18, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-18T00:32:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-18T00:32:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6812/365910818", 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6816/365910818", 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6824/365910818", 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6820/365910818", 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f", 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6832", 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6833", 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6827/2780316581", 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6829/2780316581", 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6833/2780316581", 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6831/2780316581", 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:32:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "7000f249-35b4-4770-8452-8f31064ef1de", 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 32, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6824", 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6825", 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6826", 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6827", 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6830", 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6831", 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6828", 2024-09-18T00:32:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6829", 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6825/2008948201", 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6827/2008948201", 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6831/2008948201", 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6829/2008948201", 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "755442b3-b418-409d-bd0a-376579eeb381", 2024-09-18T00:32:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6816", 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6817", 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6818", 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6819", 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6822", 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6823", 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6820", 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6821", 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6817/2331356901", 2024-09-18T00:32:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6819/2331356901", 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6823/2331356901", 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6821/2331356901", 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6b406b2b-e850-41be-bce8-9f13d2921c60", 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6800", 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6801", 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6802", 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6803", 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6806", 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6807", 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6804", 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6805", 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6801/2657673991", 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6803/2657673991", 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6807/2657673991", 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6805/2657673991", 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:32:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "8bb8987f-d8e4-494e-82ce-e1203957c35f", 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 38, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6808", 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6809", 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6810", 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6811", 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6814", 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6815", 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6812", 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6813", 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6809/2652298701", 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6811/2652298701", 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6815/2652298701", 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6813/2652298701", 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-18T00:32:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.022758+0000", 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:27.126737+0000", 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.821608+0000", 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.574908+0000", 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.569036+0000", 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.436338+0000", 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.050552+0000", 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.299077+0000", 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-18T00:32:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-18T00:32:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-18T00:32:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-18T00:32:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.324 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.325 INFO:teuthology.orchestra.run.smithi081.stdout:3368 write 0x5bd539b thru 0x5bdb569 (0x61cf bytes) 2024-09-18T00:32:30.325 INFO:teuthology.orchestra.run.smithi081.stdout:3369 read 0x2b2dacd thru 0x2b389f4 (0xaf28 bytes) 2024-09-18T00:32:30.326 INFO:tasks.thrashosds.thrasher:j is {'epoch': 62, 'fsid': '1111294f-f881-4427-a507-2f6f0939f89f', 'created': '2024-09-18T00:31:16.967705+0000', 'modified': '2024-09-18T00:32:29.043078+0000', 'last_up_change': '2024-09-18T00:31:29.069471+0000', 'last_in_change': '2024-09-18T00:31:19.984105+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T00:31:29.068996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T00:31:35.737341+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T00:31:45.237398+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 62, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f3f5415f-ac86-4dd6-8c50-5391b44b9c6b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 2689107883}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 2689107883}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 2689107883}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 2689107883}]}, 'public_addr': '172.21.15.81:6803/2689107883', 'cluster_addr': '172.21.15.81:6805/2689107883', 'heartbeat_back_addr': '172.21.15.81:6809/2689107883', 'heartbeat_front_addr': '172.21.15.81:6807/2689107883', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '06a47ef1-1ae7-40a2-a998-daac122fc229', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6811', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1726163291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6815', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6817', 'nonce': 1726163291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 1726163291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6819', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 1726163291}]}, 'public_addr': '172.21.15.81:6813/1726163291', 'cluster_addr': '172.21.15.81:6817/1726163291', 'heartbeat_back_addr': '172.21.15.81:6825/1726163291', 'heartbeat_front_addr': '172.21.15.81:6821/1726163291', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '653ab61a-1037-4190-8806-7042ef3d0586', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6812', 'nonce': 365910818}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6816', 'nonce': 365910818}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 365910818}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6818', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6820', 'nonce': 365910818}]}, 'public_addr': '172.21.15.81:6812/365910818', 'cluster_addr': '172.21.15.81:6816/365910818', 'heartbeat_back_addr': '172.21.15.81:6824/365910818', 'heartbeat_front_addr': '172.21.15.81:6820/365910818', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6827', 'nonce': 2780316581}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6828', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 2780316581}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 2780316581}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 2780316581}]}, 'public_addr': '172.21.15.81:6827/2780316581', 'cluster_addr': '172.21.15.81:6829/2780316581', 'heartbeat_back_addr': '172.21.15.81:6833/2780316581', 'heartbeat_front_addr': '172.21.15.81:6831/2780316581', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7000f249-35b4-4770-8452-8f31064ef1de', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6824', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6825', 'nonce': 2008948201}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6826', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6827', 'nonce': 2008948201}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6830', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6831', 'nonce': 2008948201}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6828', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6829', 'nonce': 2008948201}]}, 'public_addr': '172.21.15.167:6825/2008948201', 'cluster_addr': '172.21.15.167:6827/2008948201', 'heartbeat_back_addr': '172.21.15.167:6831/2008948201', 'heartbeat_front_addr': '172.21.15.167:6829/2008948201', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '755442b3-b418-409d-bd0a-376579eeb381', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6816', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6817', 'nonce': 2331356901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6818', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6819', 'nonce': 2331356901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6822', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6823', 'nonce': 2331356901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6820', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6821', 'nonce': 2331356901}]}, 'public_addr': '172.21.15.167:6817/2331356901', 'cluster_addr': '172.21.15.167:6819/2331356901', 'heartbeat_back_addr': '172.21.15.167:6823/2331356901', 'heartbeat_front_addr': '172.21.15.167:6821/2331356901', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6b406b2b-e850-41be-bce8-9f13d2921c60', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6800', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6801', 'nonce': 2657673991}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6802', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6803', 'nonce': 2657673991}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6806', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6807', 'nonce': 2657673991}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6804', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6805', 'nonce': 2657673991}]}, 'public_addr': '172.21.15.167:6801/2657673991', 'cluster_addr': '172.21.15.167:6803/2657673991', 'heartbeat_back_addr': '172.21.15.167:6807/2657673991', 'heartbeat_front_addr': '172.21.15.167:6805/2657673991', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '8bb8987f-d8e4-494e-82ce-e1203957c35f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6808', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6809', 'nonce': 2652298701}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6810', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6811', 'nonce': 2652298701}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6814', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6815', 'nonce': 2652298701}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6812', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6813', 'nonce': 2652298701}]}, 'public_addr': '172.21.15.167:6809/2652298701', 'cluster_addr': '172.21.15.167:6811/2652298701', 'heartbeat_back_addr': '172.21.15.167:6815/2652298701', 'heartbeat_front_addr': '172.21.15.167:6813/2652298701', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.022758+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:27.126737+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.821608+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.574908+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.569036+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.436338+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.050552+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.299077+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T00:32:30.326 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-18T00:32:30.327 INFO:teuthology.orchestra.run.smithi081.stdout:3370 write 0xc6300b1 thru 0xc63c932 (0xc882 bytes) 2024-09-18T00:32:30.327 INFO:teuthology.orchestra.run.smithi081.stdout:3371 trunc from 0xc63c933 to 0x41fa221 2024-09-18T00:32:30.327 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.327 INFO:teuthology.orchestra.run.smithi081.stdout:3374 read 0x12fe7f thru 0x1320b2 (0x2234 bytes) 2024-09-18T00:32:30.327 INFO:teuthology.orchestra.run.smithi081.stdout:3375 trunc from 0x41fa221 to 0x3e7765f 2024-09-18T00:32:30.328 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5129 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328849652999999, 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028611574000000001, 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5129 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964566+0000", 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964567+0000", 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0899999999999997e-07 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964568+0000", 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8050000000000001e-06 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964577+0000", 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3149999999999992e-06 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964581+0000", 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4789999999999998e-06 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993004+0000", 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028422612 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993083+0000", 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9367000000000001e-05 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993178+0000", 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4686999999999997e-05 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5130 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328829325000001, 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029079462, 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5130 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964587+0000", 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0100000000000001e-07 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964593+0000", 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0809999999999999e-06 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964599+0000", 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9660000000000001e-06 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964603+0000", 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3340000000000003e-06 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993209+0000", 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028605815 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993577+0000", 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036788599999999999 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993666+0000", 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9079000000000006e-05 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5168 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 26624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328807167999997, 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02923388, 2024-09-18T00:32:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5168 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964609+0000", 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964611+0000", 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6390000000000001e-06 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964616+0000", 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1880000000000001e-06 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964620+0000", 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993694+0000", 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029073485 2024-09-18T00:32:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993763+0000", 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9064000000000001e-05 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993843+0000", 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9919999999999994e-05 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5169 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328790644000001, 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029406055, 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5169 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964625+0000", 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964626+0000", 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964627+0000", 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6649999999999999e-06 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964633+0000", 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964637+0000", 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.189e-06 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993870+0000", 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029233424000000001 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.993951+0000", 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1051999999999996e-05 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994031+0000", 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0019999999999996e-05 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5170 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 83968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328774248999999, 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029576037999999999, 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5170 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964642+0000", 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964644+0000", 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5540000000000001e-06 2024-09-18T00:32:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964650+0000", 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0950000000000001e-06 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964654+0000", 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3250000000000001e-06 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994058+0000", 2024-09-18T00:32:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029403655000000001 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994133+0000", 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4974000000000004e-05 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994218+0000", 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5144999999999999e-05 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5171 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328754797000002, 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030497487, 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5171 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964661+0000", 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964662+0000", 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2800000000000003e-07 2024-09-18T00:32:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964663+0000", 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.722e-06 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964672+0000", 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7320000000000004e-06 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964677+0000", 2024-09-18T00:32:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.527e-06 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.994247+0000", 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029570603000000001 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995061+0000", 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00081419399999999996 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995159+0000", 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7380999999999995e-05 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5172 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328734034999997, 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030717230000000002, 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5172 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964682+0000", 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3000000000000002e-07 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964691+0000", 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6149999999999997e-06 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964697+0000", 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964705+0000", 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0320000000000003e-06 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995209+0000", 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030504452000000001 2024-09-18T00:32:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995301+0000", 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1367999999999997e-05 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995399+0000", 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8340999999999999e-05 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5173 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 169984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328705180999997, 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030867024, 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5173 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964711+0000", 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0500000000000004e-07 2024-09-18T00:32:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964713+0000", 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.84e-06 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964719+0000", 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4600000000000002e-06 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964723+0000", 2024-09-18T00:32:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995429+0000", 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030706563999999999 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995500+0000", 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0500999999999995e-05 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995578+0000", 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8035999999999996e-05 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5174 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328688337000003, 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031034297999999998, 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5174 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964728+0000", 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964730+0000", 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.655e-06 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964735+0000", 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3940000000000004e-06 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964744+0000", 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995603+0000", 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030859780999999999 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995676+0000", 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2704000000000001e-05 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995762+0000", 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5841999999999996e-05 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5175 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328666796, 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031208080999999999, 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5175 2024-09-18T00:32:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964749+0000", 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964750+0000", 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3999999999999997e-07 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964751+0000", 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.829e-06 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964757+0000", 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3789999999999997e-06 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964761+0000", 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1520000000000002e-06 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995789+0000", 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031028525000000001 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995862+0000", 2024-09-18T00:32:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2515999999999995e-05 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995957+0000", 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5340000000000005e-05 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5176 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 256000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328649806999998, 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031341039000000001, 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5176 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964766+0000", 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964767+0000", 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964768+0000", 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6610000000000001e-06 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964774+0000", 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3850000000000001e-06 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964778+0000", 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.995985+0000", 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031206289000000002 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996058+0000", 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2974999999999998e-05 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996107+0000", 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9639999999999999e-05 2024-09-18T00:32:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5177 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 284672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328632638999999, 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031522255999999998, 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5177 2024-09-18T00:32:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964783+0000", 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964784+0000", 2024-09-18T00:32:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9200000000000002e-07 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964785+0000", 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6869999999999999e-06 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964797+0000", 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1282e-05 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964801+0000", 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5510000000000001e-06 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996136+0000", 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031334870000000001 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996211+0000", 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4475999999999996e-05 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996306+0000", 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5098000000000003e-05 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5178 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 313344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328609212000003, 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031735948, 2024-09-18T00:32:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5178 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964807+0000", 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3099999999999999e-07 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964809+0000", 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7630000000000001e-06 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964819+0000", 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0224000000000001e-05 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964824+0000", 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4139999999999996e-06 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996356+0000", 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031532646999999997 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996446+0000", 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9993000000000004e-05 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996543+0000", 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6576000000000005e-05 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5179 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328586373999997, 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031953505, 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5179 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964830+0000", 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964837+0000", 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964843+0000", 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.336e-06 2024-09-18T00:32:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964848+0000", 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4440000000000001e-06 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996593+0000", 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031745821 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996680+0000", 2024-09-18T00:32:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6953000000000006e-05 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996783+0000", 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010280000000000001 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5180 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 370688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328562058999999, 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032134442999999999, 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5180 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964854+0000", 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964856+0000", 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.81e-06 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964862+0000", 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.519e-06 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964866+0000", 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2690000000000001e-06 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996812+0000", 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031946039000000002 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996899+0000", 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7064999999999994e-05 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.996988+0000", 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9370999999999995e-05 2024-09-18T00:32:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5181 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 399360~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328540418999999, 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.03234393, 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5181 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964876+0000", 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2000000000000001e-07 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964878+0000", 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.844e-06 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964883+0000", 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1100000000000002e-06 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964887+0000", 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9169999999999999e-06 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997032+0000", 2024-09-18T00:32:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032145646 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997116+0000", 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3858999999999998e-05 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997220+0000", 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010323399999999999 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5182 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 428032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328524364000003, 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032589419000000001, 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5182 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964892+0000", 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8100000000000003e-07 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964894+0000", 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6700000000000001e-06 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964899+0000", 2024-09-18T00:32:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1080000000000001e-06 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964903+0000", 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8210000000000003e-06 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997297+0000", 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032394065 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997380+0000", 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3226000000000006e-05 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997481+0000", 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101048 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5183 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328501852000002, 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032807066000000003, 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5183 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964914+0000", 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9299999999999999e-07 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964921+0000", 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964926+0000", 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5990000000000001e-06 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964934+0000", 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6809999999999998e-06 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997526+0000", 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032591805000000001 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997617+0000", 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1439000000000003e-05 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997721+0000", 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0001039 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5184 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328476062, 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033026119, 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5184 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964940+0000", 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.27e-07 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964942+0000", 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.846e-06 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964948+0000", 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5489999999999997e-06 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964952+0000", 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1060000000000002e-06 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997766+0000", 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032814589999999998 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997863+0000", 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6146999999999999e-05 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.997966+0000", 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103454 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5185 3.1 3:85c089ce:::rbd_data.1197ce767b07.0000000000000003:4 [read 514048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.328459406, 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033245331000000003, 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5185 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964957+0000", 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9400000000000001e-07 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964958+0000", 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6160000000000001e-06 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964969+0000", 2024-09-18T00:32:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.964974+0000", 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2180000000000001e-06 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998013+0000", 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033038901000000002 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998112+0000", 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9028000000000001e-05 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.998202+0000", 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0288e-05 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.420 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.421 INFO:teuthology.orchestra.run.smithi081.stdout:3376 writesame 0x79eefbb thru 0x79f18c4 data_size 0x33(0x290a bytes) 2024-09-18T00:32:30.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:30.423 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:30.323+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3377 writesame 0xe2858aa thru 0xe294d17 data_size 0x3(0xf46e bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3378 writesame 0x7901ca9 thru 0x790622e data_size 0x2(0x4586 bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3383 read 0x49e43f7 thru 0x49ee4b9 (0xa0c3 bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3384 punch from 0x7c90535 to 0x7c907a3, (0x26e bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3388 write 0x608dd7 thru 0x616451 (0xd67b bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3390 read 0xdd506f thru 0xdd981e (0x47b0 bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3392 writesame 0x98e3b15 thru 0x98e7b8e data_size 0x15(0x407a bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3394 read 0x802621c thru 0x8026290 (0x75 bytes) 2024-09-18T00:32:30.425 INFO:teuthology.orchestra.run.smithi081.stdout:3397 read 0x3ff1480 thru 0x40005db (0xf15c bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3398 read 0x3d434d5 thru 0x3d4ac06 (0x7732 bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3399 write 0x5d32701 thru 0x5d3afbc (0x88bc bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3402 writesame 0xe2de03 thru 0xe2fa32 data_size 0x2c(0x1c30 bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3403 trunc from 0xe294d18 to 0xb0713d8 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3404 write 0x8b6edf5 thru 0x8b7c5b2 (0xd7be bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3406 read 0x93a6f16 thru 0x93af05a (0x8145 bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3407 read 0x5f96660 thru 0x5f9e323 (0x7cc4 bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3408 punch from 0x5b96f24 to 0x5ba5790, (0xe86c bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3412 writesame 0xad51b60 thru 0xad5b77b data_size 0x67(0x9c1c bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3413 trunc from 0xb0713d8 to 0x39f304c 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3414 trunc from 0x39f304c to 0xd756f98 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3415 write 0xd3dcf63 thru 0xd3e95fa (0xc698 bytes) 2024-09-18T00:32:30.426 INFO:teuthology.orchestra.run.smithi081.stdout:3416 writesame 0x3a35f8a thru 0x3a4462b data_size 0x2(0xe6a2 bytes) 2024-09-18T00:32:30.427 INFO:teuthology.orchestra.run.smithi081.stdout:3417 punch from 0x1da9f78 to 0x1dac1d1, (0x2259 bytes) 2024-09-18T00:32:30.427 INFO:teuthology.orchestra.run.smithi081.stdout:3419 read 0x14cee8d thru 0x14d956c (0xa6e0 bytes) 2024-09-18T00:32:30.427 INFO:teuthology.orchestra.run.smithi081.stdout:3420 trunc from 0xd756f98 to 0x6d1b5ef 2024-09-18T00:32:30.432 INFO:teuthology.orchestra.run.smithi081.stdout:3423 read 0x1f7eebe thru 0x1f8c284 (0xd3c7 bytes) 2024-09-18T00:32:30.433 INFO:teuthology.orchestra.run.smithi081.stdout:3424 writesame 0x57b8ec6 thru 0x57c59ee data_size 0x1(0xcb29 bytes) 2024-09-18T00:32:30.433 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:30.431+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:3425 trunc from 0x6d1b5ef to 0xdc38a65 2024-09-18T00:32:30.479 INFO:teuthology.orchestra.run.smithi081.stdout:3426 write 0xa4fd73 thru 0xa50aea (0xd78 bytes) 2024-09-18T00:32:30.481 INFO:teuthology.orchestra.run.smithi081.stdout:3427 punch from 0x710ad43 to 0x7117afc, (0xcdb9 bytes) 2024-09-18T00:32:30.489 INFO:teuthology.orchestra.run.smithi081.stdout:3428 writesame 0xe628298 thru 0xe6359aa data_size 0x1(0xd713 bytes) 2024-09-18T00:32:30.501 INFO:teuthology.orchestra.run.smithi081.stdout:3430 trunc from 0xe6359ab to 0x3a2fcef 2024-09-18T00:32:30.528 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:30.527+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:30.543 INFO:teuthology.orchestra.run.smithi081.stdout:3431 writesame 0xda41a0c thru 0xda501e4 data_size 0x3d(0xe7d9 bytes) 2024-09-18T00:32:30.543 INFO:teuthology.orchestra.run.smithi081.stdout:3432 read 0xc144d43 thru 0xc152392 (0xd650 bytes) 2024-09-18T00:32:30.543 INFO:teuthology.orchestra.run.smithi081.stdout:3433 write 0x3d10db7 thru 0x3d19a64 (0x8cae bytes) 2024-09-18T00:32:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:3434 writesame 0x8660532 thru 0x866d6bf data_size 0x3(0xd18e bytes) 2024-09-18T00:32:30.549 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:30.549 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.556 INFO:teuthology.orchestra.run.smithi081.stdout:3435 write 0x5f392eb thru 0x5f47584 (0xe29a bytes) 2024-09-18T00:32:30.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:30.561 INFO:teuthology.orchestra.run.smithi081.stdout:3436 read 0xbd7ea93 thru 0xbd87556 (0x8ac4 bytes) 2024-09-18T00:32:30.561 INFO:teuthology.orchestra.run.smithi081.stdout:3437 write 0xa3ff6f8 thru 0xa409215 (0x9b1e bytes) 2024-09-18T00:32:30.576 INFO:teuthology.orchestra.run.smithi081.stdout:3439 trunc from 0xda501e5 to 0x54f6cb4 2024-09-18T00:32:30.587 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.587 INFO:teuthology.orchestra.run.smithi081.stdout:3441 read 0x330060f thru 0x330c800 (0xc1f2 bytes) 2024-09-18T00:32:30.588 INFO:teuthology.orchestra.run.smithi081.stdout:3443 write 0x491aa40 thru 0x492001c (0x55dd bytes) 2024-09-18T00:32:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:3444 writesame 0x4943e2b thru 0x494b4b3 data_size 0x69(0x7689 bytes) 2024-09-18T00:32:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:3446 punch from 0x36ad45d to 0x36aeef9, (0x1a9c bytes) 2024-09-18T00:32:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:3448 writesame 0xb0bf103 thru 0xb0cbd7c data_size 0x7(0xcc7a bytes) 2024-09-18T00:32:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:3450 read 0x4b3788 thru 0x4b509d (0x1916 bytes) 2024-09-18T00:32:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:3452 write 0x3862c13 thru 0x387204c (0xf43a bytes) 2024-09-18T00:32:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:3454 read 0x42b4c1 thru 0x437432 (0xbf72 bytes) 2024-09-18T00:32:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:3455 read 0xa704489 thru 0xa708517 (0x408f bytes) 2024-09-18T00:32:30.610 INFO:teuthology.orchestra.run.smithi081.stdout:3458 trunc from 0xb0cbd7d to 0xe14b042 2024-09-18T00:32:30.629 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:30.627+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:30.669 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:30.669 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:30.729 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:30.728+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:30.817 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.817 INFO:teuthology.orchestra.run.smithi081.stdout:3463 write 0x6153f24 thru 0x615b4c8 (0x75a5 bytes) 2024-09-18T00:32:30.819 INFO:teuthology.orchestra.run.smithi081.stdout:3464 trunc from 0xe14b042 to 0xe1e84bc 2024-09-18T00:32:30.821 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:30.821 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39869 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 137216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.351022341, 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017016, 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39869 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2e-07 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468604+0000", 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.03e-06 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468610+0000", 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8069999999999996e-06 2024-09-18T00:32:30.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468615+0000", 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485472+0000", 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016857647 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485541+0000", 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8960000000000004e-05 2024-09-18T00:32:30.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485618+0000", 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6377000000000004e-05 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350983620000001, 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:32:30.826 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:32:30.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:32:30.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350692904999999, 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350646445999999, 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350622950000002, 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350600445000001, 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350090495, 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350040407000002, 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:32:30.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.350009037, 2024-09-18T00:32:30.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:32:30.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:32:30.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.860 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.349986950000002, 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:32:30.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.349964912000001, 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39892 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348837657000001, 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016967862, 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39892 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:30.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1800000000000004e-07 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470792+0000", 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2030000000000002e-06 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470802+0000", 2024-09-18T00:32:30.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0484e-05 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470810+0000", 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5299999999999999e-06 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487600+0000", 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016790474999999999 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487673+0000", 2024-09-18T00:32:30.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2689999999999997e-05 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487754+0000", 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1562000000000003e-05 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348802890000002, 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:32:30.873 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.877 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.34877157, 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348739773999998, 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:32:30.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348714662999999, 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:32:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:32:30.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:32:30.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348671196000002, 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:32:30.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:30.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348649308999999, 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:30.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348592030999999, 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:32:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.348564941999999, 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:30.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:32:30.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:30.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:30.911 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:30.912 INFO:teuthology.orchestra.run.smithi081.stdout:3465 punch from 0x64f8ca9 to 0x64fb8eb, (0x2c42 bytes) 2024-09-18T00:32:30.912 INFO:teuthology.orchestra.run.smithi081.stdout:3466 read 0x541e73b thru 0x542aa3f (0xc305 bytes) 2024-09-18T00:32:30.912 INFO:teuthology.orchestra.run.smithi081.stdout:3467 read 0x9d2a268 thru 0x9d2af6f (0xd08 bytes) 2024-09-18T00:32:30.912 INFO:teuthology.orchestra.run.smithi081.stdout:3468 write 0x6215e14 thru 0x6220d49 (0xaf36 bytes) 2024-09-18T00:32:30.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:30.914 INFO:teuthology.orchestra.run.smithi081.stdout:3470 write 0x6084e74 thru 0x6091730 (0xc8bd bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3472 read 0x6ca713c thru 0x6caf8be (0x8783 bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3473 writesame 0x7d0e040 thru 0x7d12eec data_size 0x1(0x4ead bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3474 write 0x5b86c62 thru 0x5b90ee2 (0xa281 bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3475 write 0xbfc71a3 thru 0xbfd3c3a (0xca98 bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3477 read 0x3e2d408 thru 0x3e31cb6 (0x48af bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3478 trunc from 0xe1e84bc to 0xcdaec33 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3479 trunc from 0xcdaec33 to 0xdd94ca3 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3480 trunc from 0xdd94ca3 to 0x28b6920 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3481 read 0x15da6e0 thru 0x15ea539 (0xfe5a bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3482 read 0x1a32077 thru 0x1a35fed (0x3f77 bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3484 read 0xda43b4 thru 0xdb2a29 (0xe676 bytes) 2024-09-18T00:32:30.915 INFO:teuthology.orchestra.run.smithi081.stdout:3485 read 0x19579b8 thru 0x19632fd (0xb946 bytes) 2024-09-18T00:32:30.916 INFO:teuthology.orchestra.run.smithi081.stdout:3488 punch from 0x1f9ce83 to 0x1fa1c54, (0x4dd1 bytes) 2024-09-18T00:32:30.916 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:30.910+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:30.916 INFO:teuthology.orchestra.run.smithi081.stdout:3490 trunc from 0x28b6920 to 0x9b08cfa 2024-09-18T00:32:30.920 INFO:teuthology.orchestra.run.smithi081.stdout:3492 clone 28 order 25 su 262144 sc 13 2024-09-18T00:32:31.013 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:31.011+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:31.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:32:31.114 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:31.112+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:31.166 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:31.166 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:31.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:31.219 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:31.218+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:31.230 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-18T00:32:31.258 INFO:teuthology.orchestra.run.smithi081.stdout:3493 write 0xedd777d thru 0xede1dda (0xa65e bytes) 2024-09-18T00:32:31.264 INFO:teuthology.orchestra.run.smithi081.stdout:3494 punch from 0xf3062b to 0xf3799e, (0x7373 bytes) 2024-09-18T00:32:31.264 INFO:teuthology.orchestra.run.smithi081.stdout:3495 write 0x93d2f81 thru 0x93d31c3 (0x243 bytes) 2024-09-18T00:32:31.268 INFO:teuthology.orchestra.run.smithi081.stdout:3498 read 0x178927c thru 0x1795955 (0xc6da bytes) 2024-09-18T00:32:31.268 INFO:teuthology.orchestra.run.smithi081.stdout:3499 read 0xeae0a16 thru 0xeaf08a6 (0xfe91 bytes) 2024-09-18T00:32:31.268 INFO:teuthology.orchestra.run.smithi081.stdout:3500 read 0x45f79f4 thru 0x45fb964 (0x3f71 bytes) 2024-09-18T00:32:31.268 INFO:teuthology.orchestra.run.smithi081.stdout:3501 writesame 0xa444979 thru 0xa44c046 data_size 0x6f(0x76ce bytes) 2024-09-18T00:32:31.273 INFO:teuthology.orchestra.run.smithi081.stdout:3503 read 0x6b8d19d thru 0x6b9bdb3 (0xec17 bytes) 2024-09-18T00:32:31.273 INFO:teuthology.orchestra.run.smithi081.stdout:3505 read 0x33ae337 thru 0x33b06e6 (0x23b0 bytes) 2024-09-18T00:32:31.273 INFO:teuthology.orchestra.run.smithi081.stdout:3506 read 0xe6d8502 thru 0xe6e16b0 (0x91af bytes) 2024-09-18T00:32:31.273 INFO:teuthology.orchestra.run.smithi081.stdout:3507 write 0x28997b thru 0x292e36 (0x94bc bytes) 2024-09-18T00:32:31.277 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.291 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:31.291 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:31.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.753832795999998, 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:32:31.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:32:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.609446339999998, 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:32:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:32:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.584129511, 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:32:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:32:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:32:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:15867 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'43, mlcod=39'40)", 2024-09-18T00:32:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.839314683000001, 2024-09-18T00:32:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036878850000000001, 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449668+0000", 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9999999999999997e-07 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449673+0000", 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0950000000000003e-06 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449685+0000", 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2313999999999999e-05 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449691+0000", 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2770000000000002e-06 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449733+0000", 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2131e-05 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449752+0000", 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8987999999999998e-05 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453326+0000", 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035735290000000002 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453355+0000", 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8951000000000001e-05 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.460265092, 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:32:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:32:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:32:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16281 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'55, mlcod=39'52)", 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.459690371000001, 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034366890000000001, 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829292+0000", 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9800000000000003e-07 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829297+0000", 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2449999999999998e-06 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829310+0000", 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2649999999999999e-05 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829317+0000", 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8669999999999996e-06 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829366+0000", 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9604000000000001e-05 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829384+0000", 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7445e-05 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832703+0000", 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033195400000000002 2024-09-18T00:32:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832728+0000", 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4640000000000001e-05 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16279 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'68, mlcod=39'65)", 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.459632228, 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033756509999999999, 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829354+0000", 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2069999999999997e-06 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829363+0000", 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4209999999999995e-06 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829368+0000", 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4909999999999996e-06 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829413+0000", 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4830000000000003e-05 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829430+0000", 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7221e-05 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832693+0000", 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003262764 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832725+0000", 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2298000000000001e-05 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:32:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.381556406000001, 2024-09-18T00:32:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:32:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:32:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:32:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:32:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.381400120999999, 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:32:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.381215796999999, 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.263097444, 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:32:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.104924021999999, 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:32:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.103946088000001, 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:32:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.103219476, 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:32:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:32:31.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 20.219372710999998, 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:32:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 20.218330820999999, 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:32:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 20.213306134, 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:32:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.674088350000002, 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:32:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:43083 3.9 e48/23 3:978a70df:::rbd_data.1197f8e02b0b.0000000000000048:head v 48'175, mlcod=47'173)", 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.156217980000001, 2024-09-18T00:32:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003735454, 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132766+0000", 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133785+0000", 2024-09-18T00:32:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010192280000000001 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133805+0000", 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0177999999999999e-05 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133817+0000", 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1430000000000001e-05 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133886+0000", 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9220000000000005e-05 2024-09-18T00:32:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133905+0000", 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8698999999999998e-05 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.136451+0000", 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025461669999999998 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.136499+0000", 2024-09-18T00:32:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8507000000000002e-05 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 10.244463855999999, 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:31.386 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:31.386 INFO:teuthology.orchestra.run.smithi081.stdout:3511 trunc from 0xede1ddb to 0x361be6a 2024-09-18T00:32:31.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:31.391 INFO:teuthology.orchestra.run.smithi081.stdout:3512 writesame 0xe109461 thru 0xe110aa6 data_size 0x1(0x7646 bytes) 2024-09-18T00:32:31.391 INFO:teuthology.orchestra.run.smithi081.stdout:3514 write 0xcf4e8a2 thru 0xcf5a260 (0xb9bf bytes) 2024-09-18T00:32:31.391 INFO:teuthology.orchestra.run.smithi081.stdout:3516 punch from 0x4894599 to 0x48a4015, (0xfa7c bytes) 2024-09-18T00:32:31.391 INFO:teuthology.orchestra.run.smithi081.stdout:3517 writesame 0xe8a62b5 thru 0xe8aac7d data_size 0x1(0x49c9 bytes) 2024-09-18T00:32:31.391 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.391 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3520 read 0xc4cea06 thru 0xc4d285e (0x3e59 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3521 read 0x8125e40 thru 0x8129a7b (0x3c3c bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3523 read 0x3dfbe85 thru 0x3dff5ac (0x3728 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3526 read 0x6773246 thru 0x67739c6 (0x781 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3529 read 0xa1f9e86 thru 0xa2073aa (0xd525 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3533 read 0x2cbbf84 thru 0x2cc42ad (0x832a bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3534 punch from 0xbe50c96 to 0xbe59f87, (0x92f1 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3535 writesame 0xbd9df49 thru 0xbda50e3 data_size 0x1(0x719b bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3536 write 0x7fd35e4 thru 0x7fdf315 (0xbd32 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3537 read 0x754a03d thru 0x7557c91 (0xdc55 bytes) 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:3539 write 0xe7150e5 thru 0xe720233 (0xb14f bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3540 read 0xbc9af69 thru 0xbca6376 (0xb40e bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3542 punch from 0x8965b9f to 0x896a669, (0x4aca bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3544 writesame 0xc650d5c thru 0xc65237e data_size 0x1(0x1623 bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3545 punch from 0xaeb0e8e to 0xaec063b, (0xf7ad bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3547 read 0x71ac33d thru 0x71b1916 (0x55da bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3548 read 0x58096 thru 0x5954b (0x14b6 bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3551 read 0x3e87a1e thru 0x3e8eb3b (0x711e bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3553 read 0xa9ec61f thru 0xa9faa73 (0xe455 bytes) 2024-09-18T00:32:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:3554 read 0x35a32c6 thru 0x35a828e (0x4fc9 bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3555 read 0x8a1dfad thru 0x8a21e7d (0x3ed1 bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3556 write 0x492e595 thru 0x493d4ab (0xef17 bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3557 read 0x3ad03dd thru 0x3adeb2b (0xe74f bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3558 read 0x60a152e thru 0x60ad94a (0xc41d bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3562 punch from 0x603d22f to 0x6042eff, (0x5cd0 bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3563 read 0xcd98201 thru 0xcd9e4f3 (0x62f3 bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3565 writesame 0x9bd9343 thru 0x9be8e11 data_size 0xd(0xfacf bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3568 write 0x41dce05 thru 0x41dd264 (0x460 bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3569 read 0xc2777aa thru 0xc2807e5 (0x903c bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3570 punch from 0xa60eb72 to 0xa61eb4c, (0xffda bytes) 2024-09-18T00:32:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:3571 write 0x836630 thru 0x83b74d (0x511e bytes) 2024-09-18T00:32:31.398 INFO:teuthology.orchestra.run.smithi081.stdout:3572 trunc from 0xe8aac7e to 0x2bc5fe6 2024-09-18T00:32:31.399 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:31.397+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:31.417 INFO:teuthology.orchestra.run.smithi081.stdout:3573 write 0x6966b31 thru 0x696ae68 (0x4338 bytes) 2024-09-18T00:32:31.418 INFO:teuthology.orchestra.run.smithi081.stdout:3574 write 0xdd26ac thru 0xdd3aa0 (0x13f5 bytes) 2024-09-18T00:32:31.420 INFO:teuthology.orchestra.run.smithi081.stdout:3575 write 0x2e6ab36 thru 0x2e78637 (0xdb02 bytes) 2024-09-18T00:32:31.422 INFO:teuthology.orchestra.run.smithi081.stdout:3576 read 0x5951003 thru 0x595aa26 (0x9a24 bytes) 2024-09-18T00:32:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:3578 write 0x82e1814 thru 0x82eea91 (0xd27e bytes) 2024-09-18T00:32:31.440 INFO:teuthology.orchestra.run.smithi081.stdout:3579 write 0xb03ac03 thru 0xb04117a (0x6578 bytes) 2024-09-18T00:32:31.446 INFO:teuthology.orchestra.run.smithi081.stdout:3580 write 0xb570061 thru 0xb5722e1 (0x2281 bytes) 2024-09-18T00:32:31.454 INFO:teuthology.orchestra.run.smithi081.stdout:3582 trunc from 0xb5722e2 to 0x70ebbf4 2024-09-18T00:32:31.462 INFO:teuthology.orchestra.run.smithi081.stdout:3583 read 0x760e48 thru 0x76d295 (0xc44e bytes) 2024-09-18T00:32:31.462 INFO:teuthology.orchestra.run.smithi081.stdout:3584 write 0x19a9284 thru 0x19b7084 (0xde01 bytes) 2024-09-18T00:32:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:3586 write 0x6a6ac16 thru 0x6a6e329 (0x3714 bytes) 2024-09-18T00:32:31.474 INFO:teuthology.orchestra.run.smithi081.stdout:3587 write 0x998632e thru 0x9987068 (0xd3b bytes) 2024-09-18T00:32:31.476 INFO:teuthology.orchestra.run.smithi081.stdout:3588 read 0x5662582 thru 0x566458a (0x2009 bytes) 2024-09-18T00:32:31.476 INFO:teuthology.orchestra.run.smithi081.stdout:3589 read 0x8d527e7 thru 0x8d52d53 (0x56d bytes) 2024-09-18T00:32:31.480 INFO:teuthology.orchestra.run.smithi081.stdout:3590 trunc from 0x9987069 to 0x73ef91a 2024-09-18T00:32:31.491 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:31.489+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:31.495 INFO:teuthology.orchestra.run.smithi081.stdout:3591 read 0x25ff777 thru 0x260097b (0x1205 bytes) 2024-09-18T00:32:31.495 INFO:teuthology.orchestra.run.smithi081.stdout:3592 punch from 0x1dc2ae8 to 0x1dcabd0, (0x80e8 bytes) 2024-09-18T00:32:31.495 INFO:teuthology.orchestra.run.smithi081.stdout:3593 read 0xb5c07e thru 0xb6a9cb (0xe94e bytes) 2024-09-18T00:32:31.496 INFO:teuthology.orchestra.run.smithi081.stdout:3594 read 0x3956b7e thru 0x3965b17 (0xef9a bytes) 2024-09-18T00:32:31.496 INFO:teuthology.orchestra.run.smithi081.stdout:3595 writesame 0xce42ca thru 0xcf27ec data_size 0x1(0xe523 bytes) 2024-09-18T00:32:31.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:31.534 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:31.534 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:31.542 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.542 INFO:teuthology.orchestra.run.smithi081.stdout:3599 write 0x2315b98 thru 0x231ca89 (0x6ef2 bytes) 2024-09-18T00:32:31.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:31.545 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.545 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.549 INFO:teuthology.orchestra.run.smithi081.stdout:3602 trunc from 0x73ef91a to 0xa459e04 2024-09-18T00:32:31.554 INFO:teuthology.orchestra.run.smithi081.stdout:3603 punch from 0xdaccb9 to 0xdbc960, (0xfca7 bytes) 2024-09-18T00:32:31.554 INFO:teuthology.orchestra.run.smithi081.stdout:3604 read 0x7f9e86e thru 0x7fa31b2 (0x4945 bytes) 2024-09-18T00:32:31.555 INFO:teuthology.orchestra.run.smithi081.stdout:3605 write 0x12fc235 thru 0x12ff881 (0x364d bytes) 2024-09-18T00:32:31.556 INFO:teuthology.orchestra.run.smithi081.stdout:3606 read 0x1c0e578 thru 0x1c1ba7d (0xd506 bytes) 2024-09-18T00:32:31.557 INFO:teuthology.orchestra.run.smithi081.stdout:3610 read 0x5456f9a thru 0x545d1c7 (0x622e bytes) 2024-09-18T00:32:31.557 INFO:teuthology.orchestra.run.smithi081.stdout:3612 read 0x47ab62c thru 0x47b1073 (0x5a48 bytes) 2024-09-18T00:32:31.557 INFO:teuthology.orchestra.run.smithi081.stdout:3614 punch from 0x4e2ad70 to 0x4e30ae2, (0x5d72 bytes) 2024-09-18T00:32:31.558 INFO:teuthology.orchestra.run.smithi081.stdout:3615 writesame 0x9fbb1e thru 0x9fdb9c data_size 0x3(0x207f bytes) 2024-09-18T00:32:31.561 INFO:teuthology.orchestra.run.smithi081.stdout:3616 punch from 0x61b06ce to 0x61bbb62, (0xb494 bytes) 2024-09-18T00:32:31.561 INFO:teuthology.orchestra.run.smithi081.stdout:3617 read 0x4866720 thru 0x486cbc4 (0x64a5 bytes) 2024-09-18T00:32:31.561 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.561 INFO:teuthology.orchestra.run.smithi081.stdout:3619 read 0x11e1fa8 thru 0x11ed857 (0xb8b0 bytes) 2024-09-18T00:32:31.562 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.562 INFO:teuthology.orchestra.run.smithi081.stdout:3621 punch from 0x13ecc29 to 0x13f0865, (0x3c3c bytes) 2024-09-18T00:32:31.562 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.562 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.562 INFO:teuthology.orchestra.run.smithi081.stdout:3624 punch from 0xa0e505d to 0xa0edf87, (0x8f2a bytes) 2024-09-18T00:32:31.562 INFO:teuthology.orchestra.run.smithi081.stdout:3625 writesame 0x9b38d8f thru 0x9b41c47 data_size 0x13(0x8eb9 bytes) 2024-09-18T00:32:31.565 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.565 INFO:teuthology.orchestra.run.smithi081.stdout:3627 read 0x5cff100 thru 0x5d0b3fb (0xc2fc bytes) 2024-09-18T00:32:31.565 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.565 INFO:teuthology.orchestra.run.smithi081.stdout:3629 read 0x1d08fcc thru 0x1d0f9d4 (0x6a09 bytes) 2024-09-18T00:32:31.566 INFO:teuthology.orchestra.run.smithi081.stdout:3630 punch from 0x727f59b to 0x72853bd, (0x5e22 bytes) 2024-09-18T00:32:31.566 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.566 INFO:teuthology.orchestra.run.smithi081.stdout:3632 write 0x4a30624 thru 0x4a354d7 (0x4eb4 bytes) 2024-09-18T00:32:31.567 INFO:teuthology.orchestra.run.smithi081.stdout:3634 read 0x26e4cbd thru 0x26f315b (0xe49f bytes) 2024-09-18T00:32:31.568 INFO:teuthology.orchestra.run.smithi081.stdout:3635 read 0x2a38c7f thru 0x2a44455 (0xb7d7 bytes) 2024-09-18T00:32:31.568 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.568 INFO:teuthology.orchestra.run.smithi081.stdout:3637 write 0x8af7ae5 thru 0x8b07094 (0xf5b0 bytes) 2024-09-18T00:32:31.570 INFO:teuthology.orchestra.run.smithi081.stdout:3638 read 0x78abb2a thru 0x78ac466 (0x93d bytes) 2024-09-18T00:32:31.571 INFO:teuthology.orchestra.run.smithi081.stdout:3639 read 0x15c7be7 thru 0x15caa44 (0x2e5e bytes) 2024-09-18T00:32:31.581 INFO:teuthology.orchestra.run.smithi081.stdout:3641 writesame 0xe89eef6 thru 0xe8aeadb data_size 0x13(0xfbe6 bytes) 2024-09-18T00:32:31.583 INFO:teuthology.orchestra.run.smithi081.stdout:3642 punch from 0xd0666a0 to 0xd072330, (0xbc90 bytes) 2024-09-18T00:32:31.583 INFO:teuthology.orchestra.run.smithi081.stdout:3643 write 0x2248695 thru 0x2253e42 (0xb7ae bytes) 2024-09-18T00:32:31.584 INFO:teuthology.orchestra.run.smithi081.stdout:3644 write 0xb2e40e2 thru 0xb2e72cc (0x31eb bytes) 2024-09-18T00:32:31.586 INFO:teuthology.orchestra.run.smithi081.stdout:3645 write 0xe94eb7 thru 0xe96fc2 (0x210c bytes) 2024-09-18T00:32:31.587 INFO:teuthology.orchestra.run.smithi081.stdout:3647 write 0xade7756 thru 0xade9b38 (0x23e3 bytes) 2024-09-18T00:32:31.588 INFO:teuthology.orchestra.run.smithi081.stdout:3649 writesame 0xcaa812b thru 0xcab2634 data_size 0x41(0xa50a bytes) 2024-09-18T00:32:31.591 INFO:teuthology.orchestra.run.smithi081.stdout:3651 writesame 0xf62ffe thru 0xf6c80e data_size 0x1(0x9811 bytes) 2024-09-18T00:32:31.592 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:31.590+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:31.611 INFO:teuthology.orchestra.run.smithi081.stdout:3652 punch from 0xe69aee8 to 0xe69d412, (0x252a bytes) 2024-09-18T00:32:31.611 INFO:teuthology.orchestra.run.smithi081.stdout:3654 punch from 0x3e010c0 to 0x3e03623, (0x2563 bytes) 2024-09-18T00:32:31.611 INFO:teuthology.orchestra.run.smithi081.stdout:3655 write 0x3a24566 thru 0x3a2faa0 (0xb53b bytes) 2024-09-18T00:32:31.613 INFO:teuthology.orchestra.run.smithi081.stdout:3656 read 0x6b5541c thru 0x6b5ddf1 (0x89d6 bytes) 2024-09-18T00:32:31.613 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.613 INFO:teuthology.orchestra.run.smithi081.stdout:3659 writesame 0xd734fe3 thru 0xd73f17b data_size 0x1(0xa199 bytes) 2024-09-18T00:32:31.636 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.636 INFO:teuthology.orchestra.run.smithi081.stdout:3662 write 0xe1fe175 thru 0xe20ba92 (0xd91e bytes) 2024-09-18T00:32:31.643 INFO:teuthology.orchestra.run.smithi081.stdout:3663 write 0xedb5fd2 thru 0xedbaac1 (0x4af0 bytes) 2024-09-18T00:32:31.644 INFO:teuthology.orchestra.run.smithi081.stdout:3664 writesame 0xc7f5cfb thru 0xc80373d data_size 0x7d(0xda43 bytes) 2024-09-18T00:32:31.647 INFO:teuthology.orchestra.run.smithi081.stdout:3667 punch from 0x8734670 to 0x873bed6, (0x7866 bytes) 2024-09-18T00:32:31.647 INFO:teuthology.orchestra.run.smithi081.stdout:3668 read 0x372e7f6 thru 0x3731efe (0x3709 bytes) 2024-09-18T00:32:31.647 INFO:teuthology.orchestra.run.smithi081.stdout:3669 read 0x46a889c thru 0x46b75ee (0xed53 bytes) 2024-09-18T00:32:31.647 INFO:teuthology.orchestra.run.smithi081.stdout:3671 write 0x6da0a38 thru 0x6da6e63 (0x642c bytes) 2024-09-18T00:32:31.661 INFO:teuthology.orchestra.run.smithi081.stdout:3672 trunc from 0xedbaac2 to 0x631d93c 2024-09-18T00:32:31.661 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:31.661 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:31.661 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:31.661 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:31.662 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:31.664 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:31.664 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:31.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:31.676 INFO:teuthology.orchestra.run.smithi081.stdout:3673 read 0x19af19f thru 0x19b0834 (0x1696 bytes) 2024-09-18T00:32:31.677 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:3675 writesame 0x8358b2f thru 0x835ecd7 data_size 0x1(0x61a9 bytes) 2024-09-18T00:32:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:31.686 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:31.686 INFO:teuthology.orchestra.run.smithi081.stdout:3680 read 0x3cbcc36 thru 0x3cbf0ba (0x2485 bytes) 2024-09-18T00:32:31.687 INFO:teuthology.orchestra.run.smithi081.stdout:3685 read 0x3885187 thru 0x38864c5 (0x133f bytes) 2024-09-18T00:32:31.687 INFO:teuthology.orchestra.run.smithi081.stdout:3686 read 0x238c5cc thru 0x2397d32 (0xb767 bytes) 2024-09-18T00:32:31.692 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:31.691+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:31.697 INFO:teuthology.orchestra.run.smithi081.stdout:3687 write 0xbce34df thru 0xbcf1482 (0xdfa4 bytes) 2024-09-18T00:32:31.699 INFO:teuthology.orchestra.run.smithi081.stdout:3688 write 0x1265c67 thru 0x1273f24 (0xe2be bytes) 2024-09-18T00:32:31.701 INFO:teuthology.orchestra.run.smithi081.stdout:3689 read 0x51957f7 thru 0x51967e2 (0xfec bytes) 2024-09-18T00:32:31.701 INFO:teuthology.orchestra.run.smithi081.stdout:3691 punch from 0x863d291 to 0x8648363, (0xb0d2 bytes) 2024-09-18T00:32:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:3692 write 0x1e90ceb thru 0x1e9fa7a (0xed90 bytes) 2024-09-18T00:32:31.703 INFO:teuthology.orchestra.run.smithi081.stdout:3693 read 0x7c9a062 thru 0x7ca953a (0xf4d9 bytes) 2024-09-18T00:32:31.704 INFO:teuthology.orchestra.run.smithi081.stdout:3695 punch from 0x539927a to 0x53a65a5, (0xd32b bytes) 2024-09-18T00:32:31.704 INFO:teuthology.orchestra.run.smithi081.stdout:3697 write 0x93a5c37 thru 0x93b295d (0xcd27 bytes) 2024-09-18T00:32:31.705 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:31.705 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:31.705 INFO:teuthology.orchestra.run.smithi081.stdout:3698 punch from 0x16d7696 to 0x16e37c2, (0xc12c bytes) 2024-09-18T00:32:31.716 INFO:teuthology.orchestra.run.smithi081.stdout:3699 trunc from 0xbcf1483 to 0x34bd063 2024-09-18T00:32:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:31.724 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:31.728 INFO:teuthology.orchestra.run.smithi081.stdout:3702 read 0x26c494d thru 0x26d153f (0xcbf3 bytes) 2024-09-18T00:32:31.728 INFO:teuthology.orchestra.run.smithi081.stdout:3703 read 0x11fcd2a thru 0x1204959 (0x7c30 bytes) 2024-09-18T00:32:31.729 INFO:teuthology.orchestra.run.smithi081.stdout:3704 trunc from 0x34bd063 to 0x2e195d5 2024-09-18T00:32:31.743 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:31.751 INFO:teuthology.orchestra.run.smithi081.stdout:3707 trunc from 0x2e195d5 to 0xd9dbe7f 2024-09-18T00:32:31.762 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:31.762 INFO:teuthology.orchestra.run.smithi081.stdout:3708 trunc from 0xd9dbe7f to 0x8b03340 2024-09-18T00:32:31.771 INFO:teuthology.orchestra.run.smithi081.stdout:3709 read 0x7c2c833 thru 0x7c2cb90 (0x35e bytes) 2024-09-18T00:32:31.772 INFO:teuthology.orchestra.run.smithi081.stdout:3710 punch from 0x1e17b1f to 0x1e27152, (0xf633 bytes) 2024-09-18T00:32:31.772 INFO:teuthology.orchestra.run.smithi081.stdout:3711 write 0x3357c29 thru 0x336750e (0xf8e6 bytes) 2024-09-18T00:32:31.780 INFO:teuthology.orchestra.run.smithi081.stdout:3713 write 0x98495da thru 0x9857390 (0xddb7 bytes) 2024-09-18T00:32:31.781 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:31.781 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.790 INFO:teuthology.orchestra.run.smithi081.stdout:3715 write 0xd3ec2bb thru 0xd3ec6c7 (0x40d bytes) 2024-09-18T00:32:31.792 INFO:teuthology.orchestra.run.smithi081.stdout:3716 writesame 0x3a97528 thru 0x3a9ab9e data_size 0x1(0x3677 bytes) 2024-09-18T00:32:31.793 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:31.791+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:31.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:31.800 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:31.801 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:31.804 INFO:teuthology.orchestra.run.smithi081.stdout:3718 writesame 0x897b783 thru 0x898a3b3 data_size 0x57(0xec31 bytes) 2024-09-18T00:32:31.806 INFO:teuthology.orchestra.run.smithi081.stdout:3720 write 0x112e9a1 thru 0x113b020 (0xc680 bytes) 2024-09-18T00:32:31.809 INFO:teuthology.orchestra.run.smithi081.stdout:3721 write 0x3bba881 thru 0x3bbdc34 (0x33b4 bytes) 2024-09-18T00:32:31.811 INFO:teuthology.orchestra.run.smithi081.stdout:3722 punch from 0x15260c7 to 0x1531fad, (0xbee6 bytes) 2024-09-18T00:32:31.811 INFO:teuthology.orchestra.run.smithi081.stdout:3723 punch from 0x1c2017d to 0x1c2fa27, (0xf8aa bytes) 2024-09-18T00:32:31.811 INFO:teuthology.orchestra.run.smithi081.stdout:3725 writesame 0xbadf9e thru 0xbb05c2 data_size 0x1f(0x2625 bytes) 2024-09-18T00:32:31.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:31.813 INFO:teuthology.orchestra.run.smithi081.stdout:3726 punch from 0x891608b to 0x891d80f, (0x7784 bytes) 2024-09-18T00:32:31.813 INFO:teuthology.orchestra.run.smithi081.stdout:3727 punch from 0x41126b2 to 0x4121893, (0xf1e1 bytes) 2024-09-18T00:32:31.813 INFO:teuthology.orchestra.run.smithi081.stdout:3729 writesame 0xa7f6c69 thru 0xa802ec3 data_size 0x6b(0xc25b bytes) 2024-09-18T00:32:31.814 INFO:teuthology.orchestra.run.smithi081.stdout:3730 read 0xd222ba5 thru 0xd2249b2 (0x1e0e bytes) 2024-09-18T00:32:31.814 INFO:teuthology.orchestra.run.smithi081.stdout:3731 read 0x74919dd thru 0x7497426 (0x5a4a bytes) 2024-09-18T00:32:31.815 INFO:teuthology.orchestra.run.smithi081.stdout:3734 read 0xbc926fb thru 0xbc9c974 (0xa27a bytes) 2024-09-18T00:32:31.815 INFO:teuthology.orchestra.run.smithi081.stdout:3736 write 0x7db7663 thru 0x7dbaad5 (0x3473 bytes) 2024-09-18T00:32:31.816 INFO:teuthology.orchestra.run.smithi081.stdout:3737 writesame 0x46d56a7 thru 0x46e09fa data_size 0x4(0xb354 bytes) 2024-09-18T00:32:31.825 INFO:teuthology.orchestra.run.smithi081.stdout:3738 write 0x3e8e038 thru 0x3e9958a (0xb553 bytes) 2024-09-18T00:32:31.826 INFO:teuthology.orchestra.run.smithi081.stdout:3740 punch from 0x820169f to 0x820fb51, (0xe4b2 bytes) 2024-09-18T00:32:31.826 INFO:teuthology.orchestra.run.smithi081.stdout:3741 write 0x738acf0 thru 0x738e3a0 (0x36b1 bytes) 2024-09-18T00:32:31.827 INFO:teuthology.orchestra.run.smithi081.stdout:3742 read 0x4c1ab89 thru 0x4c1ae27 (0x29f bytes) 2024-09-18T00:32:31.841 INFO:teuthology.orchestra.run.smithi081.stdout:3743 trunc from 0xd3ec6c8 to 0x22c4d70 2024-09-18T00:32:31.851 INFO:teuthology.orchestra.run.smithi081.stdout:3744 punch from 0x60fe8c to 0x6168f5, (0x6a69 bytes) 2024-09-18T00:32:31.851 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:31.851 INFO:teuthology.orchestra.run.smithi081.stdout:3746 read 0x16c9a6 thru 0x16d8e9 (0xf44 bytes) 2024-09-18T00:32:31.851 INFO:teuthology.orchestra.run.smithi081.stdout:3747 read 0x10e9436 thru 0x10f244d (0x9018 bytes) 2024-09-18T00:32:31.852 INFO:teuthology.orchestra.run.smithi081.stdout:3748 clone 29 order 19 su 16384 sc 4 2024-09-18T00:32:31.894 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:31.893+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:31.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:32.011 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:32.010+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:32.097 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:32.095+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:32.121 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone28 from 0x22c4d70 (overlap 0x22c4d70) to 0x6f42b0 2024-09-18T00:32:32.191 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-18T00:32:32.197 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:32.196+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:32.298 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:32.296+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.354 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:32.376 INFO:teuthology.orchestra.run.smithi081.stdout:3749 punch from 0x19a9190 to 0x19b44d9, (0xb349 bytes) 2024-09-18T00:32:32.387 INFO:teuthology.orchestra.run.smithi081.stdout:3750 write 0x36dce7a thru 0x36e608d (0x9214 bytes) 2024-09-18T00:32:32.391 INFO:teuthology.orchestra.run.smithi081.stdout:3751 write 0x2cc0a8c thru 0x2cca859 (0x9dce bytes) 2024-09-18T00:32:32.398 INFO:teuthology.orchestra.run.smithi081.stdout:3752 trunc from 0x36e608e to 0x2513676 2024-09-18T00:32:32.398 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:32.397+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:32.408 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:32.408 INFO:teuthology.orchestra.run.smithi081.stdout:3754 read 0x45a1d4 thru 0x45f105 (0x4f32 bytes) 2024-09-18T00:32:32.411 INFO:teuthology.orchestra.run.smithi081.stdout:3756 trunc from 0x2513676 to 0x3c67595 2024-09-18T00:32:32.417 INFO:teuthology.orchestra.run.smithi081.stdout:3757 read 0x2246d1b thru 0x2249e39 (0x311f bytes) 2024-09-18T00:32:32.417 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:32.417 INFO:teuthology.orchestra.run.smithi081.stdout:3759 read 0x2fa41be thru 0x2fab323 (0x7166 bytes) 2024-09-18T00:32:32.417 INFO:teuthology.orchestra.run.smithi081.stdout:3761 read 0x24bb880 thru 0x24c43dd (0x8b5e bytes) 2024-09-18T00:32:32.429 INFO:teuthology.orchestra.run.smithi081.stdout:3762 writesame 0x871bada thru 0x872a724 data_size 0x1(0xec4b bytes) 2024-09-18T00:32:32.443 INFO:teuthology.orchestra.run.smithi081.stdout:3763 write 0xe639b1b thru 0xe641822 (0x7d08 bytes) 2024-09-18T00:32:32.450 INFO:teuthology.orchestra.run.smithi081.stdout:3764 write 0x71db843 thru 0x71df971 (0x412f bytes) 2024-09-18T00:32:32.455 INFO:teuthology.orchestra.run.smithi081.stdout:3765 punch from 0x229fc1e to 0x22af348, (0xf72a bytes) 2024-09-18T00:32:32.455 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:32.455 INFO:teuthology.orchestra.run.smithi081.stdout:3767 punch from 0x9718176 to 0x97212bf, (0x9149 bytes) 2024-09-18T00:32:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.471 INFO:teuthology.orchestra.run.smithi081.stdout:3768 trunc from 0xe641823 to 0x75b523 2024-09-18T00:32:32.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:32.492 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:32.510 INFO:teuthology.orchestra.run.smithi081.stdout:3770 write 0xb48c1fd thru 0xb49b52c (0xf330 bytes) 2024-09-18T00:32:32.513 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:32.512+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:32.515 INFO:teuthology.orchestra.run.smithi081.stdout:3772 writesame 0x4beed7e thru 0x4bef5ec data_size 0x1(0x86f bytes) 2024-09-18T00:32:32.520 INFO:teuthology.orchestra.run.smithi081.stdout:3773 read 0x1a67802 thru 0x1a70e94 (0x9693 bytes) 2024-09-18T00:32:32.520 INFO:teuthology.orchestra.run.smithi081.stdout:3775 read 0x21ff04f thru 0x220b3bd (0xc36f bytes) 2024-09-18T00:32:32.528 INFO:teuthology.orchestra.run.smithi081.stdout:3776 writesame 0xe048042 thru 0xe04dde2 data_size 0x1(0x5da1 bytes) 2024-09-18T00:32:32.544 INFO:teuthology.orchestra.run.smithi081.stdout:3777 trunc from 0xe04dde3 to 0x8c6ef2 2024-09-18T00:32:32.554 INFO:teuthology.orchestra.run.smithi081.stdout:3778 read 0x41b556 thru 0x429906 (0xe3b1 bytes) 2024-09-18T00:32:32.569 INFO:teuthology.orchestra.run.smithi081.stdout:3780 trunc from 0x8c6ef2 to 0xc93b971 2024-09-18T00:32:32.584 INFO:teuthology.orchestra.run.smithi081.stdout:3781 trunc from 0xc93b971 to 0x484c9f6 2024-09-18T00:32:32.590 INFO:teuthology.orchestra.run.smithi081.stdout:3782 read 0x33cf939 thru 0x33d3e7e (0x4546 bytes) 2024-09-18T00:32:32.590 INFO:teuthology.orchestra.run.smithi081.stdout:3783 punch from 0x187f162 to 0x1884f3e, (0x5ddc bytes) 2024-09-18T00:32:32.592 INFO:teuthology.orchestra.run.smithi081.stdout:3784 trunc from 0x484c9f6 to 0x307434c 2024-09-18T00:32:32.600 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:32.599+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:32.608 INFO:teuthology.orchestra.run.smithi081.stdout:3785 trunc from 0x307434c to 0xc7900b2 2024-09-18T00:32:32.614 INFO:teuthology.orchestra.run.smithi081.stdout:3787 read 0x1406a43 thru 0x14116e5 (0xaca3 bytes) 2024-09-18T00:32:32.614 INFO:teuthology.orchestra.run.smithi081.stdout:3788 trunc from 0xc7900b2 to 0xc09428d 2024-09-18T00:32:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.620 INFO:teuthology.orchestra.run.smithi081.stdout:3789 write 0x359c01e thru 0x35a4b85 (0x8b68 bytes) 2024-09-18T00:32:32.625 INFO:teuthology.orchestra.run.smithi081.stdout:3790 write 0x9ca902c thru 0x9cb5d18 (0xcced bytes) 2024-09-18T00:32:32.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:32.632 INFO:teuthology.orchestra.run.smithi081.stdout:3791 write 0x62b7bc0 thru 0x62b82ef (0x730 bytes) 2024-09-18T00:32:32.635 INFO:teuthology.orchestra.run.smithi081.stdout:3792 write 0xbc045cb thru 0xbc13086 (0xeabc bytes) 2024-09-18T00:32:32.645 INFO:teuthology.orchestra.run.smithi081.stdout:3793 trunc from 0xc09428d to 0x7bb52d3 2024-09-18T00:32:32.661 INFO:teuthology.orchestra.run.smithi081.stdout:3795 trunc from 0x7bb52d3 to 0x397f672 2024-09-18T00:32:32.670 INFO:teuthology.orchestra.run.smithi081.stdout:3797 punch from 0x205adf1 to 0x205f5b2, (0x47c1 bytes) 2024-09-18T00:32:32.676 INFO:teuthology.orchestra.run.smithi081.stdout:3799 write 0x43e6135 thru 0x43ebf41 (0x5e0d bytes) 2024-09-18T00:32:32.683 INFO:teuthology.orchestra.run.smithi081.stdout:3800 punch from 0x2749a3a to 0x274fae7, (0x60ad bytes) 2024-09-18T00:32:32.690 INFO:teuthology.orchestra.run.smithi081.stdout:3801 trunc from 0x43ebf42 to 0xa6fe696 2024-09-18T00:32:32.696 INFO:teuthology.orchestra.run.smithi081.stdout:3802 punch from 0x72cd462 to 0x72d5bfc, (0x879a bytes) 2024-09-18T00:32:32.697 INFO:teuthology.orchestra.run.smithi081.stdout:3803 punch from 0x1e279e2 to 0x1e33b1e, (0xc13c bytes) 2024-09-18T00:32:32.697 INFO:teuthology.orchestra.run.smithi081.stdout:3804 read 0x87eedf6 thru 0x87fe926 (0xfb31 bytes) 2024-09-18T00:32:32.697 INFO:teuthology.orchestra.run.smithi081.stdout:3805 read 0x7f0d82b thru 0x7f1a1ab (0xc981 bytes) 2024-09-18T00:32:32.697 INFO:teuthology.orchestra.run.smithi081.stdout:3806 write 0x3c8ba53 thru 0x3c90814 (0x4dc2 bytes) 2024-09-18T00:32:32.701 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:32.700+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:32.711 INFO:teuthology.orchestra.run.smithi081.stdout:3807 trunc from 0xa6fe696 to 0x5620dad 2024-09-18T00:32:32.717 INFO:teuthology.orchestra.run.smithi081.stdout:3810 write 0x2e4c4fb thru 0x2e5a46a (0xdf70 bytes) 2024-09-18T00:32:32.723 INFO:teuthology.orchestra.run.smithi081.stdout:3811 punch from 0x177a065 to 0x1786750, (0xc6eb bytes) 2024-09-18T00:32:32.723 INFO:teuthology.orchestra.run.smithi081.stdout:3813 read 0x4d73058 thru 0x4d7930d (0x62b6 bytes) 2024-09-18T00:32:32.735 INFO:teuthology.orchestra.run.smithi081.stdout:3814 write 0xb2b7fd8 thru 0xb2bc854 (0x487d bytes) 2024-09-18T00:32:32.740 INFO:teuthology.orchestra.run.smithi081.stdout:3815 writesame 0x7b6d283 thru 0x7b772dd data_size 0x1(0xa05b bytes) 2024-09-18T00:32:32.768 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:32.768 INFO:teuthology.orchestra.run.smithi081.stdout:3817 writesame 0x535f64f thru 0x5361b71 data_size 0x3(0x2523 bytes) 2024-09-18T00:32:32.776 INFO:teuthology.orchestra.run.smithi081.stdout:3818 write 0xcc0715 thru 0xcc7bf5 (0x74e1 bytes) 2024-09-18T00:32:32.780 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.780 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.780 INFO:teuthology.orchestra.run.smithi081.stdout:3820 clone 30 order 25 su 262144 sc 11 2024-09-18T00:32:32.789 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:32.832 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:32.831+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:32.900 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:32.941 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:32.940+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:33.004 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:33.003+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:33.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:32:33.116 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:33.115+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:33.132 INFO:teuthology.orchestra.run.smithi081.stdout:flattening image image_client.0-clone29 2024-09-18T00:32:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:33.206 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:33.204+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:33.303 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-18T00:32:33.315 INFO:teuthology.orchestra.run.smithi081.stdout:3821 writesame 0x5665d89 thru 0x5667e07 data_size 0x3(0x207f bytes) 2024-09-18T00:32:33.325 INFO:teuthology.orchestra.run.smithi081.stdout:3822 write 0x5cfec9f thru 0x5d03073 (0x43d5 bytes) 2024-09-18T00:32:33.332 INFO:teuthology.orchestra.run.smithi081.stdout:3823 write 0xad3a8c3 thru 0xad4139a (0x6ad8 bytes) 2024-09-18T00:32:33.337 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:33.336+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:33.341 INFO:teuthology.orchestra.run.smithi081.stdout:3824 read 0x841882f thru 0x8424161 (0xb933 bytes) 2024-09-18T00:32:33.341 INFO:teuthology.orchestra.run.smithi081.stdout:3825 write 0x86c1fce thru 0x86c7c51 (0x5c84 bytes) 2024-09-18T00:32:33.343 INFO:teuthology.orchestra.run.smithi081.stdout:3826 read 0x761c6dd thru 0x7629e60 (0xd784 bytes) 2024-09-18T00:32:33.353 INFO:teuthology.orchestra.run.smithi081.stdout:3830 write 0xe64ac95 thru 0xe65a417 (0xf783 bytes) 2024-09-18T00:32:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.409 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:33.407+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:33.410 INFO:teuthology.orchestra.run.smithi081.stdout:3831 read 0x1e6dbc7 thru 0x1e6f45e (0x1898 bytes) 2024-09-18T00:32:33.410 INFO:teuthology.orchestra.run.smithi081.stdout:3832 read 0xaf3e3df thru 0xaf4b9be (0xd5e0 bytes) 2024-09-18T00:32:33.410 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.410 INFO:teuthology.orchestra.run.smithi081.stdout:3835 write 0x8843a1b thru 0x88445df (0xbc5 bytes) 2024-09-18T00:32:33.410 INFO:teuthology.orchestra.run.smithi081.stdout:3836 trunc from 0xe65a418 to 0x1df8bfe 2024-09-18T00:32:33.412 INFO:teuthology.orchestra.run.smithi081.stdout:3837 write 0xba06667 thru 0xba145a4 (0xdf3e bytes) 2024-09-18T00:32:33.415 INFO:teuthology.orchestra.run.smithi081.stdout:3838 trunc from 0xba145a5 to 0xaeba5ea 2024-09-18T00:32:33.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:33.424 INFO:teuthology.orchestra.run.smithi081.stdout:3839 read 0x60cf3e4 thru 0x60d0860 (0x147d bytes) 2024-09-18T00:32:33.430 INFO:teuthology.orchestra.run.smithi081.stdout:3840 trunc from 0xaeba5ea to 0x5eba98e 2024-09-18T00:32:33.439 INFO:teuthology.orchestra.run.smithi081.stdout:3842 read 0x14b1f47 thru 0x14b246b (0x525 bytes) 2024-09-18T00:32:33.447 INFO:teuthology.orchestra.run.smithi081.stdout:3845 trunc from 0x5eba98e to 0x36b51c 2024-09-18T00:32:33.456 INFO:teuthology.orchestra.run.smithi081.stdout:3846 read 0x2f587b thru 0x2f8f34 (0x36ba bytes) 2024-09-18T00:32:33.458 INFO:teuthology.orchestra.run.smithi081.stdout:3848 trunc from 0x36b51c to 0x16bf041 2024-09-18T00:32:33.485 INFO:teuthology.orchestra.run.smithi081.stdout:3849 write 0xecfc216 thru 0xed015e9 (0x53d4 bytes) 2024-09-18T00:32:33.486 INFO:teuthology.orchestra.run.smithi081.stdout:3851 read 0x6ce0f35 thru 0x6ce13d0 (0x49c bytes) 2024-09-18T00:32:33.492 INFO:teuthology.orchestra.run.smithi081.stdout:3852 trunc from 0xed015ea to 0xab2168b 2024-09-18T00:32:33.501 INFO:teuthology.orchestra.run.smithi081.stdout:3853 write 0x3ba1061 thru 0x3ba5c91 (0x4c31 bytes) 2024-09-18T00:32:33.503 INFO:teuthology.orchestra.run.smithi081.stdout:3854 read 0x34b3b4d thru 0x34b8639 (0x4aed bytes) 2024-09-18T00:32:33.510 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:33.509+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:33.510 INFO:teuthology.orchestra.run.smithi081.stdout:3856 writesame 0xc4c297f thru 0xc4d0ab6 data_size 0x4(0xe138 bytes) 2024-09-18T00:32:33.512 INFO:teuthology.orchestra.run.smithi081.stdout:3857 writesame 0xbf55114 thru 0xbf55c68 data_size 0x1(0xb55 bytes) 2024-09-18T00:32:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:3858 punch from 0xc278998 to 0xc281b40, (0x91a8 bytes) 2024-09-18T00:32:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:3859 punch from 0x61bfb36 to 0x61ca197, (0xa661 bytes) 2024-09-18T00:32:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:3861 punch from 0x64e028e to 0x64f0007, (0xfd79 bytes) 2024-09-18T00:32:33.516 INFO:teuthology.orchestra.run.smithi081.stdout:3862 writesame 0xbd6b5fc thru 0xbd6ef71 data_size 0x5(0x3976 bytes) 2024-09-18T00:32:33.519 INFO:teuthology.orchestra.run.smithi081.stdout:3863 write 0x2703682 thru 0x27133af (0xfd2e bytes) 2024-09-18T00:32:33.521 INFO:teuthology.orchestra.run.smithi081.stdout:3864 writesame 0x16620cb thru 0x1671e38 data_size 0x21(0xfd6e bytes) 2024-09-18T00:32:33.524 INFO:teuthology.orchestra.run.smithi081.stdout:3865 punch from 0xac286a2 to 0xac3656d, (0xdecb bytes) 2024-09-18T00:32:33.524 INFO:teuthology.orchestra.run.smithi081.stdout:3866 write 0x97dbdaa thru 0x97de3ba (0x2611 bytes) 2024-09-18T00:32:33.526 INFO:teuthology.orchestra.run.smithi081.stdout:3867 punch from 0x2a1c41a to 0x2a1eb54, (0x273a bytes) 2024-09-18T00:32:33.526 INFO:teuthology.orchestra.run.smithi081.stdout:3869 punch from 0xb3087a4 to 0xb3137d0, (0xb02c bytes) 2024-09-18T00:32:33.526 INFO:teuthology.orchestra.run.smithi081.stdout:3870 write 0x7b60f09 thru 0x7b69c18 (0x8d10 bytes) 2024-09-18T00:32:33.527 INFO:teuthology.orchestra.run.smithi081.stdout:3871 read 0x33dc735 thru 0x33e04ab (0x3d77 bytes) 2024-09-18T00:32:33.527 INFO:teuthology.orchestra.run.smithi081.stdout:3872 read 0x320a3a2 thru 0x320ff71 (0x5bd0 bytes) 2024-09-18T00:32:33.529 INFO:teuthology.orchestra.run.smithi081.stdout:3873 trunc from 0xc4d0ab7 to 0xb413b1c 2024-09-18T00:32:33.537 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.538 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.539 INFO:teuthology.orchestra.run.smithi081.stdout:3877 read 0x25197ec thru 0x2521f6d (0x8782 bytes) 2024-09-18T00:32:33.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:33.550 INFO:teuthology.orchestra.run.smithi081.stdout:3878 trunc from 0xb413b1c to 0x341bf1e 2024-09-18T00:32:33.556 INFO:teuthology.orchestra.run.smithi081.stdout:3879 punch from 0x2b38ac to 0x2be510, (0xac64 bytes) 2024-09-18T00:32:33.556 INFO:teuthology.orchestra.run.smithi081.stdout:3880 read 0x301d469 thru 0x3024787 (0x731f bytes) 2024-09-18T00:32:33.557 INFO:teuthology.orchestra.run.smithi081.stdout:3881 read 0x253eae2 thru 0x254cc3e (0xe15d bytes) 2024-09-18T00:32:33.560 INFO:teuthology.orchestra.run.smithi081.stdout:3882 trunc from 0x341bf1e to 0x144ccee 2024-09-18T00:32:33.578 INFO:teuthology.orchestra.run.smithi081.stdout:3883 writesame 0x4fac7db thru 0x4fad67a data_size 0xd(0xea0 bytes) 2024-09-18T00:32:33.579 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.579 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.579 INFO:teuthology.orchestra.run.smithi081.stdout:3886 punch from 0x3f86ba1 to 0x3f8ac2c, (0x408b bytes) 2024-09-18T00:32:33.586 INFO:teuthology.orchestra.run.smithi081.stdout:3888 write 0x62a04e4 thru 0x62aed5a (0xe877 bytes) 2024-09-18T00:32:33.588 INFO:teuthology.orchestra.run.smithi081.stdout:3889 read 0x5fcc79b thru 0x5fd08da (0x4140 bytes) 2024-09-18T00:32:33.588 INFO:teuthology.orchestra.run.smithi081.stdout:3891 read 0x4ff8e9f thru 0x5007110 (0xe272 bytes) 2024-09-18T00:32:33.589 INFO:teuthology.orchestra.run.smithi081.stdout:3892 write 0xdcb0ed thru 0xdd82c4 (0xd1d8 bytes) 2024-09-18T00:32:33.590 INFO:teuthology.orchestra.run.smithi081.stdout:3894 read 0x5bd1929 thru 0x5bdb284 (0x995c bytes) 2024-09-18T00:32:33.590 INFO:teuthology.orchestra.run.smithi081.stdout:3895 punch from 0x80e10 to 0x8e83c, (0xda2c bytes) 2024-09-18T00:32:33.592 INFO:teuthology.orchestra.run.smithi081.stdout:3896 trunc from 0x62aed5b to 0x50c62df 2024-09-18T00:32:33.599 INFO:teuthology.orchestra.run.smithi081.stdout:3897 read 0xdb9cf0 thru 0xdc3e0e (0xa11f bytes) 2024-09-18T00:32:33.600 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.600 INFO:teuthology.orchestra.run.smithi081.stdout:3900 write 0x26c8823 thru 0x26cf1f5 (0x69d3 bytes) 2024-09-18T00:32:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:3901 read 0x35d050c thru 0x35df363 (0xee58 bytes) 2024-09-18T00:32:33.612 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:33.610+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:33.612 INFO:teuthology.orchestra.run.smithi081.stdout:3902 writesame 0x9d6529f thru 0x9d6fafd data_size 0x1(0xa85f bytes) 2024-09-18T00:32:33.614 INFO:teuthology.orchestra.run.smithi081.stdout:3903 write 0x2b2bc62 thru 0x2b3294a (0x6ce9 bytes) 2024-09-18T00:32:33.615 INFO:teuthology.orchestra.run.smithi081.stdout:3904 read 0x42ea3c2 thru 0x42f1278 (0x6eb7 bytes) 2024-09-18T00:32:33.619 INFO:teuthology.orchestra.run.smithi081.stdout:3905 trunc from 0x9d6fafe to 0x7363ee4 2024-09-18T00:32:33.633 INFO:teuthology.orchestra.run.smithi081.stdout:3906 writesame 0x83bcbe4 thru 0x83c219f data_size 0xc(0x55bc bytes) 2024-09-18T00:32:33.642 INFO:teuthology.orchestra.run.smithi081.stdout:3907 writesame 0xa4d1e96 thru 0xa4dce29 data_size 0x22(0xaf94 bytes) 2024-09-18T00:32:33.644 INFO:teuthology.orchestra.run.smithi081.stdout:3909 write 0x7c5cebd thru 0x7c67a07 (0xab4b bytes) 2024-09-18T00:32:33.646 INFO:teuthology.orchestra.run.smithi081.stdout:3910 punch from 0x10cb5e to 0x11686d, (0x9d0f bytes) 2024-09-18T00:32:33.646 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.652 INFO:teuthology.orchestra.run.smithi081.stdout:3912 writesame 0xb4573dd thru 0xb45e30c data_size 0x8(0x6f30 bytes) 2024-09-18T00:32:33.654 INFO:teuthology.orchestra.run.smithi081.stdout:3913 read 0x5282b02 thru 0x529189d (0xed9c bytes) 2024-09-18T00:32:33.658 INFO:teuthology.orchestra.run.smithi081.stdout:3914 trunc from 0xb45e30d to 0x8495d78 2024-09-18T00:32:33.665 INFO:teuthology.orchestra.run.smithi081.stdout:3915 read 0xebdddb thru 0xec24dc (0x4702 bytes) 2024-09-18T00:32:33.667 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.667 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.671 INFO:teuthology.orchestra.run.smithi081.stdout:3916 trunc from 0x8495d78 to 0xd9f669f 2024-09-18T00:32:33.676 INFO:teuthology.orchestra.run.smithi081.stdout:3917 read 0x64aed7 thru 0x650af1 (0x5c1b bytes) 2024-09-18T00:32:33.677 INFO:teuthology.orchestra.run.smithi081.stdout:3919 read 0x124a5c thru 0x12ce68 (0x840d bytes) 2024-09-18T00:32:33.677 INFO:teuthology.orchestra.run.smithi081.stdout:3923 read 0x6aa3938 thru 0x6aa5f24 (0x25ed bytes) 2024-09-18T00:32:33.678 INFO:teuthology.orchestra.run.smithi081.stdout:3925 writesame 0x3cc832 thru 0x3d823b data_size 0x1(0xba0a bytes) 2024-09-18T00:32:33.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:33.708 INFO:teuthology.orchestra.run.smithi081.stdout:3926 writesame 0xb1e6e50 thru 0xb1f0776 data_size 0x7(0x9927 bytes) 2024-09-18T00:32:33.712 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:33.711+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:33.713 INFO:teuthology.orchestra.run.smithi081.stdout:3927 writesame 0x53dddb7 thru 0x53e6334 data_size 0x7(0x857e bytes) 2024-09-18T00:32:33.717 INFO:teuthology.orchestra.run.smithi081.stdout:3928 read 0x79870e thru 0x7995ab (0xe9e bytes) 2024-09-18T00:32:33.718 INFO:teuthology.orchestra.run.smithi081.stdout:3929 read 0x43a538c thru 0x43a727f (0x1ef4 bytes) 2024-09-18T00:32:33.718 INFO:teuthology.orchestra.run.smithi081.stdout:3931 read 0x8c11c45 thru 0x8c159d4 (0x3d90 bytes) 2024-09-18T00:32:33.724 INFO:teuthology.orchestra.run.smithi081.stdout:3932 write 0xdde09f7 thru 0xdde8dc7 (0x83d1 bytes) 2024-09-18T00:32:33.726 INFO:teuthology.orchestra.run.smithi081.stdout:3933 write 0x816c18 thru 0x81ba5b (0x4e44 bytes) 2024-09-18T00:32:33.727 INFO:teuthology.orchestra.run.smithi081.stdout:3934 write 0x209c606 thru 0x209d512 (0xf0d bytes) 2024-09-18T00:32:33.736 INFO:teuthology.orchestra.run.smithi081.stdout:3935 trunc from 0xdde8dc8 to 0x730c53d 2024-09-18T00:32:33.761 INFO:teuthology.orchestra.run.smithi081.stdout:3936 write 0xec160ac thru 0xec1758e (0x14e3 bytes) 2024-09-18T00:32:33.762 INFO:teuthology.orchestra.run.smithi081.stdout:3937 write 0xe905ed1 thru 0xe9159fb (0xfb2b bytes) 2024-09-18T00:32:33.764 INFO:teuthology.orchestra.run.smithi081.stdout:3938 read 0xd4b7a73 thru 0xd4b8402 (0x990 bytes) 2024-09-18T00:32:33.765 INFO:teuthology.orchestra.run.smithi081.stdout:3939 punch from 0x8c3909d to 0x8c39474, (0x3d7 bytes) 2024-09-18T00:32:33.765 INFO:teuthology.orchestra.run.smithi081.stdout:3940 write 0xc062aeb thru 0xc0711e6 (0xe6fc bytes) 2024-09-18T00:32:33.767 INFO:teuthology.orchestra.run.smithi081.stdout:3941 write 0xe6d3efc thru 0xe6e36de (0xf7e3 bytes) 2024-09-18T00:32:33.768 INFO:teuthology.orchestra.run.smithi081.stdout:3943 read 0xa6e5adb thru 0xa6f486f (0xed95 bytes) 2024-09-18T00:32:33.769 INFO:teuthology.orchestra.run.smithi081.stdout:3944 read 0xe2e5d8d thru 0xe2e60f4 (0x368 bytes) 2024-09-18T00:32:33.769 INFO:teuthology.orchestra.run.smithi081.stdout:3945 write 0x90e9bd8 thru 0x90f2dd6 (0x91ff bytes) 2024-09-18T00:32:33.771 INFO:teuthology.orchestra.run.smithi081.stdout:3946 read 0xe5f6662 thru 0xe5fd1cc (0x6b6b bytes) 2024-09-18T00:32:33.771 INFO:teuthology.orchestra.run.smithi081.stdout:3950 write 0xd7646cb thru 0xd76f1bc (0xaaf2 bytes) 2024-09-18T00:32:33.777 INFO:teuthology.orchestra.run.smithi081.stdout:3951 trunc from 0xec1758f to 0xb1f4f6c 2024-09-18T00:32:33.785 INFO:teuthology.orchestra.run.smithi081.stdout:3952 write 0x5c6ea9b thru 0x5c77b50 (0x90b6 bytes) 2024-09-18T00:32:33.790 INFO:teuthology.orchestra.run.smithi081.stdout:3954 trunc from 0xb1f4f6c to 0xd5431b6 2024-09-18T00:32:33.797 INFO:teuthology.orchestra.run.smithi081.stdout:3955 trunc from 0xd5431b6 to 0xb83bfb7 2024-09-18T00:32:33.806 INFO:teuthology.orchestra.run.smithi081.stdout:3956 punch from 0x52b308c to 0x52c1754, (0xe6c8 bytes) 2024-09-18T00:32:33.806 INFO:teuthology.orchestra.run.smithi081.stdout:3957 punch from 0xa90f787 to 0xa9135ac, (0x3e25 bytes) 2024-09-18T00:32:33.806 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.812 INFO:teuthology.orchestra.run.smithi081.stdout:3960 trunc from 0xb83bfb7 to 0x63eb0d6 2024-09-18T00:32:33.813 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:33.811+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:33.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:33.820 INFO:teuthology.orchestra.run.smithi081.stdout:3962 write 0x26b9c70 thru 0x26c9401 (0xf792 bytes) 2024-09-18T00:32:33.830 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.830 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.831 INFO:teuthology.orchestra.run.smithi081.stdout:3963 writesame 0xa44e0d5 thru 0xa4511ec data_size 0x4(0x3118 bytes) 2024-09-18T00:32:33.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:33.844 INFO:teuthology.orchestra.run.smithi081.stdout:3964 writesame 0xeaaf706 thru 0xeab9d58 data_size 0x3(0xa653 bytes) 2024-09-18T00:32:33.855 INFO:teuthology.orchestra.run.smithi081.stdout:3965 trunc from 0xeab9d59 to 0x64af187 2024-09-18T00:32:33.865 INFO:teuthology.orchestra.run.smithi081.stdout:3966 trunc from 0x64af187 to 0x85668f9 2024-09-18T00:32:33.877 INFO:teuthology.orchestra.run.smithi081.stdout:3968 write 0x9be976f thru 0x9bf4330 (0xabc2 bytes) 2024-09-18T00:32:33.878 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.891 INFO:teuthology.orchestra.run.smithi081.stdout:3970 write 0xe37d0d8 thru 0xe3816bc (0x45e5 bytes) 2024-09-18T00:32:33.895 INFO:teuthology.orchestra.run.smithi081.stdout:3972 trunc from 0xe3816bd to 0xd143834 2024-09-18T00:32:33.906 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.907 INFO:teuthology.orchestra.run.smithi081.stdout:3977 punch from 0xbb60c3e to 0xbb69d20, (0x90e2 bytes) 2024-09-18T00:32:33.907 INFO:teuthology.orchestra.run.smithi081.stdout:3978 read 0xb7c7002 thru 0xb7ce3a5 (0x73a4 bytes) 2024-09-18T00:32:33.907 INFO:teuthology.orchestra.run.smithi081.stdout:3980 punch from 0x79da6ef to 0x79dfc80, (0x5591 bytes) 2024-09-18T00:32:33.914 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:33.913+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:33.915 INFO:teuthology.orchestra.run.smithi081.stdout:3984 trunc from 0xd143834 to 0x717bfc1 2024-09-18T00:32:33.931 INFO:teuthology.orchestra.run.smithi081.stdout:3986 trunc from 0x717bfc1 to 0xa11967e 2024-09-18T00:32:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:3987 writesame 0x8281316 thru 0x828a3db data_size 0x47(0x90c6 bytes) 2024-09-18T00:32:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:3988 write 0x943cd6e thru 0x9440d4a (0x3fdd bytes) 2024-09-18T00:32:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:3989 read 0x9a4f4a5 thru 0x9a545e3 (0x513f bytes) 2024-09-18T00:32:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:3991 write 0x3df0977 thru 0x3df5de6 (0x5470 bytes) 2024-09-18T00:32:33.944 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:33.944 INFO:teuthology.orchestra.run.smithi081.stdout:3993 trunc from 0xa11967e to 0x9c8c323 2024-09-18T00:32:33.954 INFO:teuthology.orchestra.run.smithi081.stdout:3994 writesame 0x4a7ace0 thru 0x4a83065 data_size 0x82(0x8386 bytes) 2024-09-18T00:32:33.956 INFO:teuthology.orchestra.run.smithi081.stdout:3995 punch from 0x4842984 to 0x485005b, (0xd6d7 bytes) 2024-09-18T00:32:33.956 INFO:teuthology.orchestra.run.smithi081.stdout:3996 writesame 0x104a5c8 thru 0x1051c50 data_size 0x55(0x7689 bytes) 2024-09-18T00:32:33.963 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:33.963 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:33.965 INFO:teuthology.orchestra.run.smithi081.stdout:3997 write 0xb14cfaf thru 0xb1516a6 (0x46f8 bytes) 2024-09-18T00:32:33.967 INFO:teuthology.orchestra.run.smithi081.stdout:3998 write 0x287cb16 thru 0x2889a8c (0xcf77 bytes) 2024-09-18T00:32:33.967 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:33.967 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:33.969 INFO:teuthology.orchestra.run.smithi081.stdout:3999 punch from 0x9d1e6c to 0x9d9766, (0x78fa bytes) 2024-09-18T00:32:33.969 INFO:teuthology.orchestra.run.smithi081.stdout:4000 write 0x73e387a thru 0x73eb047 (0x77ce bytes) 2024-09-18T00:32:33.970 INFO:teuthology.orchestra.run.smithi081.stdout:4001 write 0x4bb71 thru 0x4f74b (0x3bdb bytes) 2024-09-18T00:32:33.972 INFO:teuthology.orchestra.run.smithi081.stdout:4004 write 0x1955a39 thru 0x1963252 (0xd81a bytes) 2024-09-18T00:32:33.974 INFO:teuthology.orchestra.run.smithi081.stdout:4006 read 0x3b8bf25 thru 0x3b9528f (0x936b bytes) 2024-09-18T00:32:33.974 INFO:teuthology.orchestra.run.smithi081.stdout:4010 read 0x692c900 thru 0x693a737 (0xde38 bytes) 2024-09-18T00:32:33.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:33.984 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:33.985 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:33.985 INFO:teuthology.orchestra.run.smithi081.stdout:4011 writesame 0xd7f18d8 thru 0xd800918 data_size 0x1(0xf041 bytes) 2024-09-18T00:32:33.987 INFO:teuthology.orchestra.run.smithi081.stdout:4013 trunc from 0xd800919 to 0xea1e7d1 2024-09-18T00:32:33.992 INFO:teuthology.orchestra.run.smithi081.stdout:4014 read 0x9ff1a68 thru 0x9ff1c07 (0x1a0 bytes) 2024-09-18T00:32:33.992 INFO:teuthology.orchestra.run.smithi081.stdout:4015 punch from 0x9573589 to 0x95809de, (0xd455 bytes) 2024-09-18T00:32:33.992 INFO:teuthology.orchestra.run.smithi081.stdout:4016 write 0x944820f thru 0x9452481 (0xa273 bytes) 2024-09-18T00:32:33.994 INFO:teuthology.orchestra.run.smithi081.stdout:4017 write 0xe64ff75 thru 0xe65acd0 (0xad5c bytes) 2024-09-18T00:32:33.996 INFO:teuthology.orchestra.run.smithi081.stdout:4018 read 0x40313e2 thru 0x403e7cc (0xd3eb bytes) 2024-09-18T00:32:33.997 INFO:teuthology.orchestra.run.smithi081.stdout:4020 write 0xe3add94 thru 0xe3b0165 (0x23d2 bytes) 2024-09-18T00:32:33.998 INFO:teuthology.orchestra.run.smithi081.stdout:4022 read 0x3f8dd42 thru 0x3f8efad (0x126c bytes) 2024-09-18T00:32:33.999 INFO:teuthology.orchestra.run.smithi081.stdout:4023 write 0x151b1c4 thru 0x15244bb (0x92f8 bytes) 2024-09-18T00:32:34.001 INFO:teuthology.orchestra.run.smithi081.stdout:4024 read 0xd19560 thru 0xd20600 (0x70a1 bytes) 2024-09-18T00:32:34.001 INFO:teuthology.orchestra.run.smithi081.stdout:4026 write 0xa2c3b91 thru 0xa2cffe0 (0xc450 bytes) 2024-09-18T00:32:34.002 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:34.002 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:34.003 INFO:teuthology.orchestra.run.smithi081.stdout:4027 writesame 0x4a86ccb thru 0x4a8fbe8 data_size 0x7(0x8f1e bytes) 2024-09-18T00:32:34.015 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:34.014+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:34.018 INFO:teuthology.orchestra.run.smithi081.stdout:4028 trunc from 0xea1e7d1 to 0x5c2c1e5 2024-09-18T00:32:34.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:34.021 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:34.026 INFO:teuthology.orchestra.run.smithi081.stdout:4029 write 0x577a1be thru 0x577cb8b (0x29ce bytes) 2024-09-18T00:32:34.028 INFO:teuthology.orchestra.run.smithi081.stdout:4030 punch from 0x2868e5a to 0x2875bc3, (0xcd69 bytes) 2024-09-18T00:32:34.028 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.028 INFO:teuthology.orchestra.run.smithi081.stdout:4033 read 0x472b04c thru 0x47322ed (0x72a2 bytes) 2024-09-18T00:32:34.028 INFO:teuthology.orchestra.run.smithi081.stdout:4035 read 0x4b0b459 thru 0x4b0ba7d (0x625 bytes) 2024-09-18T00:32:34.029 INFO:teuthology.orchestra.run.smithi081.stdout:4036 read 0x29430a7 thru 0x2949259 (0x61b3 bytes) 2024-09-18T00:32:34.029 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.029 INFO:teuthology.orchestra.run.smithi081.stdout:4038 read 0x57e5db2 thru 0x57ee2a9 (0x84f8 bytes) 2024-09-18T00:32:34.029 INFO:teuthology.orchestra.run.smithi081.stdout:4039 writesame 0xf28d7d thru 0xf378d1 data_size 0x1(0xeb55 bytes) 2024-09-18T00:32:34.039 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:34.055 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:34.066 INFO:teuthology.orchestra.run.smithi081.stdout:4040 read 0x89a4ea thru 0x8a43f1 (0x9f08 bytes) 2024-09-18T00:32:34.067 INFO:teuthology.orchestra.run.smithi081.stdout:4042 write 0x1a2da43 thru 0x1a3af2e (0xd4ec bytes) 2024-09-18T00:32:34.071 INFO:teuthology.orchestra.run.smithi081.stdout:4043 read 0x825084 thru 0x834a43 (0xf9c0 bytes) 2024-09-18T00:32:34.071 INFO:teuthology.orchestra.run.smithi081.stdout:4044 read 0xddc3f4 thru 0xde3d1f (0x792c bytes) 2024-09-18T00:32:34.072 INFO:teuthology.orchestra.run.smithi081.stdout:4046 write 0x22213b thru 0x227495 (0x535b bytes) 2024-09-18T00:32:34.074 INFO:teuthology.orchestra.run.smithi081.stdout:4048 write 0x28d5b9f thru 0x28e3831 (0xdc93 bytes) 2024-09-18T00:32:34.076 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:32:34.076 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:34.076 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:34.088 INFO:teuthology.orchestra.run.smithi081.stdout:4049 write 0x73c9a54 thru 0x73caea9 (0x1456 bytes) 2024-09-18T00:32:34.090 INFO:teuthology.orchestra.run.smithi081.stdout:4050 write 0x3986912 thru 0x398b63d (0x4d2c bytes) 2024-09-18T00:32:34.092 INFO:teuthology.orchestra.run.smithi081.stdout:4051 read 0x10d9002 thru 0x10e8c65 (0xfc64 bytes) 2024-09-18T00:32:34.092 INFO:teuthology.orchestra.run.smithi081.stdout:4052 write 0x1d265dd thru 0x1d2e743 (0x8167 bytes) 2024-09-18T00:32:34.093 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:34.105 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:34.105 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:34.105 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:34.105 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:34.105 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:34.107 INFO:teuthology.orchestra.run.smithi081.stdout:4055 write 0xd83bf8c thru 0xd841f3e (0x5fb3 bytes) 2024-09-18T00:32:34.111 INFO:teuthology.orchestra.run.smithi081.stdout:4056 write 0xbf0808 thru 0xbfe4d2 (0xdccb bytes) 2024-09-18T00:32:34.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:34.115 INFO:teuthology.orchestra.run.smithi081.stdout:4057 write 0x706580e thru 0x7072dc8 (0xd5bb bytes) 2024-09-18T00:32:34.117 INFO:teuthology.orchestra.run.smithi081.stdout:4058 writesame 0x6b12b9c thru 0x6b1e45b data_size 0x20(0xb8c0 bytes) 2024-09-18T00:32:34.118 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:34.116+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:34.125 INFO:teuthology.orchestra.run.smithi081.stdout:4059 trunc from 0xd841f3f to 0x8bcafd5 2024-09-18T00:32:34.135 INFO:teuthology.orchestra.run.smithi081.stdout:4061 punch from 0x4309406 to 0x430ec09, (0x5803 bytes) 2024-09-18T00:32:34.135 INFO:teuthology.orchestra.run.smithi081.stdout:4062 read 0x303c298 thru 0x303d00e (0xd77 bytes) 2024-09-18T00:32:34.136 INFO:teuthology.orchestra.run.smithi081.stdout:4063 writesame 0x26dcb97 thru 0x26e0c17 data_size 0x7(0x4081 bytes) 2024-09-18T00:32:34.139 INFO:teuthology.orchestra.run.smithi081.stdout:4064 write 0x7a38646 thru 0x7a47fd7 (0xf992 bytes) 2024-09-18T00:32:34.141 INFO:teuthology.orchestra.run.smithi081.stdout:4066 read 0x744753a thru 0x744cbc4 (0x568b bytes) 2024-09-18T00:32:34.141 INFO:teuthology.orchestra.run.smithi081.stdout:4067 write 0x1e34107 thru 0x1e37ef8 (0x3df2 bytes) 2024-09-18T00:32:34.143 INFO:teuthology.orchestra.run.smithi081.stdout:4068 write 0x1423bc4 thru 0x14270d6 (0x3513 bytes) 2024-09-18T00:32:34.144 INFO:teuthology.orchestra.run.smithi081.stdout:4069 write 0x7e5b1f5 thru 0x7e670ed (0xbef9 bytes) 2024-09-18T00:32:34.146 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.146 INFO:teuthology.orchestra.run.smithi081.stdout:4071 read 0x4821dd4 thru 0x4822c48 (0xe75 bytes) 2024-09-18T00:32:34.159 INFO:teuthology.orchestra.run.smithi081.stdout:4072 writesame 0xec8c129 thru 0xec9a52a data_size 0x41(0xe402 bytes) 2024-09-18T00:32:34.160 INFO:teuthology.orchestra.run.smithi081.stdout:4073 punch from 0x68254dc to 0x6834255, (0xed79 bytes) 2024-09-18T00:32:34.160 INFO:teuthology.orchestra.run.smithi081.stdout:4074 read 0xdcbc85e thru 0xdcc66df (0x9e82 bytes) 2024-09-18T00:32:34.160 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.162 INFO:teuthology.orchestra.run.smithi081.stdout:4076 trunc from 0xec9a52b to 0xd90e060 2024-09-18T00:32:34.170 INFO:teuthology.orchestra.run.smithi081.stdout:4077 write 0x8bcfaf4 thru 0x8bdc47e (0xc98b bytes) 2024-09-18T00:32:34.172 INFO:teuthology.orchestra.run.smithi081.stdout:4078 write 0x1493011 thru 0x149c66e (0x965e bytes) 2024-09-18T00:32:34.188 INFO:teuthology.orchestra.run.smithi081.stdout:4079 trunc from 0xd90e060 to 0x1bc89e8 2024-09-18T00:32:34.197 INFO:teuthology.orchestra.run.smithi081.stdout:4080 read 0xb482cf thru 0xb4fdf9 (0x7b2b bytes) 2024-09-18T00:32:34.197 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.197 INFO:teuthology.orchestra.run.smithi081.stdout:4082 read 0x1682935 thru 0x1691f05 (0xf5d1 bytes) 2024-09-18T00:32:34.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.217 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:34.215+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:34.217 INFO:teuthology.orchestra.run.smithi081.stdout:4084 write 0xdb363c2 thru 0xdb3fa9c (0x96db bytes) 2024-09-18T00:32:34.219 INFO:teuthology.orchestra.run.smithi081.stdout:4087 writesame 0x1bb6c28 thru 0x1bb75ff data_size 0x23(0x9d8 bytes) 2024-09-18T00:32:34.221 INFO:teuthology.orchestra.run.smithi081.stdout:4088 trunc from 0xdb3fa9d to 0xdf623ba 2024-09-18T00:32:34.226 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.226 INFO:teuthology.orchestra.run.smithi081.stdout:4090 punch from 0xd835496 to 0xd844525, (0xf08f bytes) 2024-09-18T00:32:34.226 INFO:teuthology.orchestra.run.smithi081.stdout:4091 writesame 0x8d42308 thru 0x8d46da9 data_size 0x2(0x4aa2 bytes) 2024-09-18T00:32:34.233 INFO:teuthology.orchestra.run.smithi081.stdout:4092 read 0xaabd066 thru 0xaac6239 (0x91d4 bytes) 2024-09-18T00:32:34.233 INFO:teuthology.orchestra.run.smithi081.stdout:4093 write 0x8a493d4 thru 0x8a54710 (0xb33d bytes) 2024-09-18T00:32:34.238 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:34.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39869 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 137216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.767382220000002, 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017016, 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39869 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468602+0000", 2024-09-18T00:32:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2e-07 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468604+0000", 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.03e-06 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468610+0000", 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8069999999999996e-06 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468615+0000", 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485472+0000", 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016857647 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485541+0000", 2024-09-18T00:32:34.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8960000000000004e-05 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485618+0000", 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6377000000000004e-05 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.767343498999999, 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:32:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.767052784000001, 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:32:34.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:32:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.767006325000001, 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:32:34.253 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:32:34.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766982829, 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:32:34.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:32:34.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766960323999999, 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766450374000001, 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.270 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766400286, 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:32:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:32:34.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766368916000001, 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766346829, 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.283 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.766324790999999, 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:32:34.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:32:34.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39892 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 171008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765197535999999, 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016967862, 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39892 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470787+0000", 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1800000000000004e-07 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470792+0000", 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2030000000000002e-06 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470802+0000", 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0484e-05 2024-09-18T00:32:34.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470810+0000", 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5299999999999999e-06 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487600+0000", 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016790474999999999 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487673+0000", 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2689999999999997e-05 2024-09-18T00:32:34.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487754+0000", 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1562000000000003e-05 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765162769, 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:32:34.292 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:32:34.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:32:34.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765131448999998, 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765099653, 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:32:34.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:32:34.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765074542000001, 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765031075, 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:34.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:32:34.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.313 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.765009188000001, 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:32:34.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:32:34.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.764951910000001, 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.764924821000001, 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:32:34.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:32:34.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.326 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:34.327 INFO:teuthology.orchestra.run.smithi081.stdout:4094 trunc from 0xdf623ba to 0x877eae8 2024-09-18T00:32:34.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:34.329 INFO:teuthology.orchestra.run.smithi081.stdout:4095 punch from 0x4048f82 to 0x40521c5, (0x9243 bytes) 2024-09-18T00:32:34.329 INFO:teuthology.orchestra.run.smithi081.stdout:4097 trunc from 0x877eae8 to 0x5ee3591 2024-09-18T00:32:34.329 INFO:teuthology.orchestra.run.smithi081.stdout:4099 write 0x4ee48f7 thru 0x4ef0a1c (0xc126 bytes) 2024-09-18T00:32:34.329 INFO:teuthology.orchestra.run.smithi081.stdout:4100 read 0x42c7c60 thru 0x42cab16 (0x2eb7 bytes) 2024-09-18T00:32:34.329 INFO:teuthology.orchestra.run.smithi081.stdout:4102 write 0x2f1e317 thru 0x2f1e85a (0x544 bytes) 2024-09-18T00:32:34.329 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4105 read 0x503561a thru 0x503f569 (0x9f50 bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4108 write 0xd3ff3f1 thru 0xd4064c7 (0x70d7 bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4111 trunc from 0xd4064c8 to 0xcff36be 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4115 writesame 0x97132d5 thru 0x9721650 data_size 0x45(0xe37c bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4118 write 0x553038c thru 0x5531165 (0xdda bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4119 punch from 0x76d2931 to 0x76d3f48, (0x1617 bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4121 writesame 0xf9d39a thru 0xfaa8b1 data_size 0xc(0xd518 bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4124 write 0x716fe07 thru 0x717906e (0x9268 bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4125 writesame 0xe854b00 thru 0xe85f909 data_size 0x1(0xae0a bytes) 2024-09-18T00:32:34.330 INFO:teuthology.orchestra.run.smithi081.stdout:4126 writesame 0xa976f97 thru 0xa983dc5 data_size 0x1(0xce2f bytes) 2024-09-18T00:32:34.331 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:34.326+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:34.356 INFO:teuthology.orchestra.run.smithi081.stdout:4127 write 0xe4bbbce thru 0xe4c0a7e (0x4eb1 bytes) 2024-09-18T00:32:34.359 INFO:teuthology.orchestra.run.smithi081.stdout:4131 punch from 0xacef91 to 0xad8228, (0x9297 bytes) 2024-09-18T00:32:34.359 INFO:teuthology.orchestra.run.smithi081.stdout:4132 read 0xd95dfed thru 0xd96b066 (0xd07a bytes) 2024-09-18T00:32:34.360 INFO:teuthology.orchestra.run.smithi081.stdout:4133 read 0x47bc31b thru 0x47cc223 (0xff09 bytes) 2024-09-18T00:32:34.360 INFO:teuthology.orchestra.run.smithi081.stdout:4135 punch from 0x6d05cf9 to 0x6d141a6, (0xe4ad bytes) 2024-09-18T00:32:34.360 INFO:teuthology.orchestra.run.smithi081.stdout:4136 write 0x644d06f thru 0x644d156 (0xe8 bytes) 2024-09-18T00:32:34.361 INFO:teuthology.orchestra.run.smithi081.stdout:4137 read 0x1703e05 thru 0x1704a7c (0xc78 bytes) 2024-09-18T00:32:34.362 INFO:teuthology.orchestra.run.smithi081.stdout:4138 writesame 0x8228b69 thru 0x822fd1b data_size 0x1(0x71b3 bytes) 2024-09-18T00:32:34.380 INFO:teuthology.orchestra.run.smithi081.stdout:4140 writesame 0xbc64eb7 thru 0xbc6903e data_size 0x24(0x4188 bytes) 2024-09-18T00:32:34.383 INFO:teuthology.orchestra.run.smithi081.stdout:4141 write 0xbdf4d29 thru 0xbdfbf87 (0x725f bytes) 2024-09-18T00:32:34.385 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.385 INFO:teuthology.orchestra.run.smithi081.stdout:4144 writesame 0x99aee44 thru 0x99be3e0 data_size 0x1(0xf59d bytes) 2024-09-18T00:32:34.428 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:34.427+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:34.433 INFO:teuthology.orchestra.run.smithi081.stdout:4145 read 0xb2d4eb6 thru 0xb2dd8b7 (0x8a02 bytes) 2024-09-18T00:32:34.434 INFO:teuthology.orchestra.run.smithi081.stdout:4146 write 0x2b19b75 thru 0x2b20796 (0x6c22 bytes) 2024-09-18T00:32:34.437 INFO:teuthology.orchestra.run.smithi081.stdout:4147 writesame 0xca9e29d thru 0xcaa6bc6 data_size 0x61(0x892a bytes) 2024-09-18T00:32:34.438 INFO:teuthology.orchestra.run.smithi081.stdout:4148 writesame 0x4347fdf thru 0x4352a64 data_size 0x49(0xaa86 bytes) 2024-09-18T00:32:34.442 INFO:teuthology.orchestra.run.smithi081.stdout:4149 trunc from 0xe85f90a to 0xd560a04 2024-09-18T00:32:34.462 INFO:teuthology.orchestra.run.smithi081.stdout:4150 write 0xdab89f3 thru 0xdabb958 (0x2f66 bytes) 2024-09-18T00:32:34.464 INFO:teuthology.orchestra.run.smithi081.stdout:4151 read 0x80abb33 thru 0x80b9e94 (0xe362 bytes) 2024-09-18T00:32:34.464 INFO:teuthology.orchestra.run.smithi081.stdout:4153 write 0x6d20249 thru 0x6d20b94 (0x94c bytes) 2024-09-18T00:32:34.466 INFO:teuthology.orchestra.run.smithi081.stdout:4154 write 0xa550c28 thru 0xa55af31 (0xa30a bytes) 2024-09-18T00:32:34.467 INFO:teuthology.orchestra.run.smithi081.stdout:4158 write 0x1614919 thru 0x161beab (0x7593 bytes) 2024-09-18T00:32:34.469 INFO:teuthology.orchestra.run.smithi081.stdout:4159 read 0x5ca0eab thru 0x5ca43de (0x3534 bytes) 2024-09-18T00:32:34.469 INFO:teuthology.orchestra.run.smithi081.stdout:4160 write 0x4d01bda thru 0x4d028b3 (0xcda bytes) 2024-09-18T00:32:34.470 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.470 INFO:teuthology.orchestra.run.smithi081.stdout:4164 write 0xce071ca thru 0xce147ae (0xd5e5 bytes) 2024-09-18T00:32:34.472 INFO:teuthology.orchestra.run.smithi081.stdout:4165 writesame 0x1cbd42a thru 0x1cc8cfc data_size 0x1(0xb8d3 bytes) 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:71422 3.0 e66/23 3:0072ff85:::rbd_data.1197ba415d8b.0000000000000004:head v 66'260, mlcod=66'258)", 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:34.478816+0000", 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000515341, 2024-09-18T00:32:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053802799999999997, 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478816+0000", 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478816+0000", 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478817+0000", 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2759999999999999e-06 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478839+0000", 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1991e-05 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478855+0000", 2024-09-18T00:32:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6087999999999999e-05 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478864+0000", 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5900000000000008e-06 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478923+0000", 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9568999999999998e-05 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:34.478943+0000", 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0152999999999998e-05 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-18T00:32:34.484 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:34.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:34.507 INFO:teuthology.orchestra.run.smithi081.stdout:4166 punch from 0x61d1c22 to 0x61d70d0, (0x54ae bytes) 2024-09-18T00:32:34.507 INFO:teuthology.orchestra.run.smithi081.stdout:4167 write 0xc2b378a thru 0xc2c0485 (0xccfc bytes) 2024-09-18T00:32:34.509 INFO:teuthology.orchestra.run.smithi081.stdout:4168 punch from 0x1fa0801 to 0x1faef4a, (0xe749 bytes) 2024-09-18T00:32:34.513 INFO:teuthology.orchestra.run.smithi081.stdout:4170 trunc from 0xdabb959 to 0xa14163c 2024-09-18T00:32:34.522 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.522 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.522 INFO:teuthology.orchestra.run.smithi081.stdout:4175 punch from 0x2094f9d to 0x209d4e0, (0x8543 bytes) 2024-09-18T00:32:34.522 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.522 INFO:teuthology.orchestra.run.smithi081.stdout:4178 write 0x913287 thru 0x91397f (0x6f9 bytes) 2024-09-18T00:32:34.523 INFO:teuthology.orchestra.run.smithi081.stdout:4182 read 0x6c097a2 thru 0x6c16719 (0xcf78 bytes) 2024-09-18T00:32:34.528 INFO:teuthology.orchestra.run.smithi081.stdout:4183 writesame 0xa177dbc thru 0xa178030 data_size 0x1(0x275 bytes) 2024-09-18T00:32:34.529 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:34.527+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:34.529 INFO:teuthology.orchestra.run.smithi081.stdout:4184 write 0x8ed858b thru 0x8ed85ae (0x24 bytes) 2024-09-18T00:32:34.530 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:34.537 INFO:teuthology.orchestra.run.smithi081.stdout:4186 trunc from 0xa178031 to 0x47353b4 2024-09-18T00:32:34.544 INFO:teuthology.orchestra.run.smithi081.stdout:4187 punch from 0xc0e1e4 to 0xc1a834, (0xc650 bytes) 2024-09-18T00:32:34.545 INFO:teuthology.orchestra.run.smithi081.stdout:4188 read 0x1ea484d thru 0x1eaf202 (0xa9b6 bytes) 2024-09-18T00:32:34.545 INFO:teuthology.orchestra.run.smithi081.stdout:4190 clone 31 order 23 su 65536 sc 15 2024-09-18T00:32:34.615 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:34.616 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:34.616 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:34.616 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:34.616 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:34.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:34.665 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:34.664+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:34.730 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:34.728+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:34.769 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.231835852000003, 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:32:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.087449395999997, 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:32:34.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:32:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.062132566999999, 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:32:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:15867 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'43, mlcod=39'40)", 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.317317739000003, 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036878850000000001, 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449667+0000", 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449668+0000", 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9999999999999997e-07 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449673+0000", 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0950000000000003e-06 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449685+0000", 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2313999999999999e-05 2024-09-18T00:32:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449691+0000", 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2770000000000002e-06 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449733+0000", 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2131e-05 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.449752+0000", 2024-09-18T00:32:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8987999999999998e-05 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453326+0000", 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035735290000000002 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.453355+0000", 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8951000000000001e-05 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.938268147999999, 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:32:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:32:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:32:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16281 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'55, mlcod=39'52)", 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.937693426999999, 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034366890000000001, 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829291+0000", 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829292+0000", 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9800000000000003e-07 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829297+0000", 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2449999999999998e-06 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829310+0000", 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2649999999999999e-05 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829317+0000", 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8669999999999996e-06 2024-09-18T00:32:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829366+0000", 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9604000000000001e-05 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829384+0000", 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7445e-05 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832703+0000", 2024-09-18T00:32:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033195400000000002 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832728+0000", 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4640000000000001e-05 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16279 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'68, mlcod=39'65)", 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.937635283999999, 2024-09-18T00:32:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033756509999999999, 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829350+0000", 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829354+0000", 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2069999999999997e-06 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829363+0000", 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4209999999999995e-06 2024-09-18T00:32:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829368+0000", 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4909999999999996e-06 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829413+0000", 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4830000000000003e-05 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.829430+0000", 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7221e-05 2024-09-18T00:32:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832693+0000", 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003262764 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832725+0000", 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2298000000000001e-05 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:32:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.859559462, 2024-09-18T00:32:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:32:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.859403177000001, 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:34.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:32:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.859218853000002, 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.813 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:34.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:32:34.817 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.741100500000002, 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:32:34.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.582927078000001, 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:32:34.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.581949143999999, 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:32:34.826 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:32:34.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:32:34.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.581222531999998, 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:32:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:32:34.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.697375767, 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.696333877000001, 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.691309189999998, 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:32:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:32:34.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.152091406, 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:32:34.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:32:34.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:43083 3.9 e48/23 3:978a70df:::rbd_data.1197f8e02b0b.0000000000000048:head v 48'175, mlcod=47'173)", 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.634221036, 2024-09-18T00:32:34.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003735454, 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132764+0000", 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.132766+0000", 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133785+0000", 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010192280000000001 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133805+0000", 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0177999999999999e-05 2024-09-18T00:32:34.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133817+0000", 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1430000000000001e-05 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133886+0000", 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9220000000000005e-05 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.133905+0000", 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8698999999999998e-05 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.136451+0000", 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025461669999999998 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:13.136499+0000", 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8507000000000002e-05 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.722466912, 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:32:34.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:32:34.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:34.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:34.861 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:34.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:34.863 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:34.860+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:34.964 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:34.962+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:35.006 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:35.006 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:35.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:35.064 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:35.062+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:35.124 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:35.125 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:35.125 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:35.125 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:35.125 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:35.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:35.149 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone30 from 0x47353b4 (overlap 0x36b51c) to 0x1b5a8e 2024-09-18T00:32:35.164 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:35.163+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:35.207 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-18T00:32:35.265 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:35.263+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:35.275 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.305555241, 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.305175583999997, 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.304346400999997, 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:35.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.297561797999997, 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.289 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:35.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:35.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.297541332000002, 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:35.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:35.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.297517243000001, 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:35.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.295671280999997, 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:35.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.295607462, 2024-09-18T00:32:35.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:35.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.295578581999997, 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.312 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.295553605999999, 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:35.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.295534554, 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.293585757000002, 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:35.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:35.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.293563300000002, 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:35.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.293534860000001, 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:35.334 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.338 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.293512552000003, 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:35.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:35.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.293492100000002, 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:35.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.292662651000001, 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.348 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:35.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.292621726, 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:35.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.292580479000002, 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:35.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:35.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.292557813999998, 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:35.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:35.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:35.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:35.365 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:35.365 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:35.365 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:35.366 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-18T00:32:35.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-18T00:32:35.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:35.368 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:35.366+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:35.459 INFO:teuthology.orchestra.run.smithi081.stdout:4191 write 0x4e6485c thru 0x4e651f1 (0x996 bytes) 2024-09-18T00:32:35.467 INFO:teuthology.orchestra.run.smithi081.stdout:4192 punch from 0x39ece4b to 0x39f6016, (0x91cb bytes) 2024-09-18T00:32:35.467 INFO:teuthology.orchestra.run.smithi081.stdout:4193 write 0x2652068 thru 0x26572ee (0x5287 bytes) 2024-09-18T00:32:35.468 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:35.466+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:35.477 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:35.477 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:35.487 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:35.491 INFO:teuthology.orchestra.run.smithi081.stdout:4194 writesame 0xc9f05d0 thru 0xc9fc530 data_size 0x7(0xbf61 bytes) 2024-09-18T00:32:35.491 INFO:teuthology.orchestra.run.smithi081.stdout:4196 punch from 0x52e56cc to 0x52e93be, (0x3cf2 bytes) 2024-09-18T00:32:35.491 INFO:teuthology.orchestra.run.smithi081.stdout:4197 read 0xc2b8720 thru 0xc2c7a4f (0xf330 bytes) 2024-09-18T00:32:35.491 INFO:teuthology.orchestra.run.smithi081.stdout:4199 read 0xa751048 thru 0xa75bbb1 (0xab6a bytes) 2024-09-18T00:32:35.492 INFO:teuthology.orchestra.run.smithi081.stdout:4200 read 0x4b04254 thru 0x4b09a4c (0x57f9 bytes) 2024-09-18T00:32:35.492 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.492 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.500 INFO:teuthology.orchestra.run.smithi081.stdout:4203 writesame 0xe2fe3a6 thru 0xe308e07 data_size 0x71(0xaa62 bytes) 2024-09-18T00:32:35.500 INFO:teuthology.orchestra.run.smithi081.stdout:4204 punch from 0xc6ab32a to 0xc6b201e, (0x6cf4 bytes) 2024-09-18T00:32:35.500 INFO:teuthology.orchestra.run.smithi081.stdout:4206 read 0xc48c356 thru 0xc492186 (0x5e31 bytes) 2024-09-18T00:32:35.500 INFO:teuthology.orchestra.run.smithi081.stdout:4207 punch from 0x5a5096b to 0x5a5910b, (0x87a0 bytes) 2024-09-18T00:32:35.500 INFO:teuthology.orchestra.run.smithi081.stdout:4208 read 0x8dfc333 thru 0x8e0ae09 (0xead7 bytes) 2024-09-18T00:32:35.503 INFO:teuthology.orchestra.run.smithi081.stdout:4209 trunc from 0xe308e08 to 0xb678a2a 2024-09-18T00:32:35.512 INFO:teuthology.orchestra.run.smithi081.stdout:4210 trunc from 0xb678a2a to 0xc7458d7 2024-09-18T00:32:35.518 INFO:teuthology.orchestra.run.smithi081.stdout:4211 writesame 0xb586acf thru 0xb587ad7 data_size 0x1(0x1009 bytes) 2024-09-18T00:32:35.535 INFO:teuthology.orchestra.run.smithi081.stdout:4212 trunc from 0xc7458d7 to 0x25754e2 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:35.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:35.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:35.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-18T00:32:35.589 INFO:teuthology.orchestra.run.smithi081.stdout:4213 read 0x241d25c thru 0x2426242 (0x8fe7 bytes) 2024-09-18T00:32:35.589 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:35.588+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:35.590 INFO:teuthology.orchestra.run.smithi081.stdout:4214 read 0x201678e thru 0x201b751 (0x4fc4 bytes) 2024-09-18T00:32:35.596 INFO:teuthology.orchestra.run.smithi081.stdout:4215 write 0x34dd868 thru 0x34e2715 (0x4eae bytes) 2024-09-18T00:32:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:35.611 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:35.611 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:35.611 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:35.613 INFO:teuthology.orchestra.run.smithi081.stdout:4216 write 0xbc3b950 thru 0xbc45393 (0x9a44 bytes) 2024-09-18T00:32:35.617 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.621 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:35.624 INFO:teuthology.orchestra.run.smithi081.stdout:4218 write 0xcc11e71 thru 0xcc12a18 (0xba8 bytes) 2024-09-18T00:32:35.629 INFO:teuthology.orchestra.run.smithi081.stdout:4219 punch from 0xab1ed3e to 0xab23d9c, (0x505e bytes) 2024-09-18T00:32:35.637 INFO:teuthology.orchestra.run.smithi081.stdout:4220 write 0xcd99018 thru 0xcd9fb9d (0x6b86 bytes) 2024-09-18T00:32:35.640 INFO:teuthology.orchestra.run.smithi081.stdout:4221 write 0x73d8699 thru 0x73df25e (0x6bc6 bytes) 2024-09-18T00:32:35.642 INFO:teuthology.orchestra.run.smithi081.stdout:4223 punch from 0x6766b1c to 0x6775c80, (0xf164 bytes) 2024-09-18T00:32:35.647 INFO:teuthology.orchestra.run.smithi081.stdout:4225 trunc from 0xcd9fb9e to 0x903d003 2024-09-18T00:32:35.655 INFO:teuthology.orchestra.run.smithi081.stdout:4227 write 0x2c175d0 thru 0x2c1bb4e (0x457f bytes) 2024-09-18T00:32:35.656 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.657 INFO:teuthology.orchestra.run.smithi081.stdout:4230 punch from 0x7eacedc to 0x7ebb3fb, (0xe51f bytes) 2024-09-18T00:32:35.657 INFO:teuthology.orchestra.run.smithi081.stdout:4232 read 0x5301d thru 0x53759 (0x73d bytes) 2024-09-18T00:32:35.669 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:35.667+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:35.669 INFO:teuthology.orchestra.run.smithi081.stdout:4233 writesame 0xd00c8da thru 0xd017c1b data_size 0xd(0xb342 bytes) 2024-09-18T00:32:35.674 INFO:teuthology.orchestra.run.smithi081.stdout:4235 trunc from 0xd017c1c to 0x9b433a5 2024-09-18T00:32:35.686 INFO:teuthology.orchestra.run.smithi081.stdout:4236 read 0x7fb9734 thru 0x7fc5cc2 (0xc58f bytes) 2024-09-18T00:32:35.687 INFO:teuthology.orchestra.run.smithi081.stdout:4237 trunc from 0x9b433a5 to 0xa909c44 2024-09-18T00:32:35.693 INFO:teuthology.orchestra.run.smithi081.stdout:4238 read 0x9477d95 thru 0x94866b5 (0xe921 bytes) 2024-09-18T00:32:35.694 INFO:teuthology.orchestra.run.smithi081.stdout:4239 writesame 0x2146191 thru 0x2152620 data_size 0xaa(0xc490 bytes) 2024-09-18T00:32:35.696 INFO:teuthology.orchestra.run.smithi081.stdout:4241 trunc from 0xa909c44 to 0xab968bc 2024-09-18T00:32:35.703 INFO:teuthology.orchestra.run.smithi081.stdout:4242 punch from 0x9f1026c to 0x9f1e248, (0xdfdc bytes) 2024-09-18T00:32:35.703 INFO:teuthology.orchestra.run.smithi081.stdout:4244 punch from 0x9624aa4 to 0x962d5c1, (0x8b1d bytes) 2024-09-18T00:32:35.703 INFO:teuthology.orchestra.run.smithi081.stdout:4245 read 0x7d593f9 thru 0x7d5c7d1 (0x33d9 bytes) 2024-09-18T00:32:35.712 INFO:teuthology.orchestra.run.smithi081.stdout:4247 write 0xe157e73 thru 0xe15f3b2 (0x7540 bytes) 2024-09-18T00:32:35.715 INFO:teuthology.orchestra.run.smithi081.stdout:4248 read 0x28cffb thru 0x292aad (0x5ab3 bytes) 2024-09-18T00:32:35.716 INFO:teuthology.orchestra.run.smithi081.stdout:4249 writesame 0xd0a3c42 thru 0xd0ac749 data_size 0xc(0x8b08 bytes) 2024-09-18T00:32:35.720 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.721 INFO:teuthology.orchestra.run.smithi081.stdout:4251 write 0x3f32e69 thru 0x3f346c4 (0x185c bytes) 2024-09-18T00:32:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:4252 writesame 0xa07a098 thru 0xa07f20f data_size 0x2c(0x5178 bytes) 2024-09-18T00:32:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588937579, 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.736 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:35.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588917116000001, 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.740 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:35.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:35.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.744 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588897720999999, 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:35.748 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588878565999998, 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.749 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:35.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588859136, 2024-09-18T00:32:35.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588839481000001, 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.758 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:35.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588820487, 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588781562000001, 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588761481999999, 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588741738, 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588721959000001, 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588702371, 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:35.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588672904999999, 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.787 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:35.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.790 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.791 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588642572000001, 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:35.794 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.795 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:35.796 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588615841999999, 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:35.797 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:35.798 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588588444999999, 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:35.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:35.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:35.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588562801999998, 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.809 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588537895999998, 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.810 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.811 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:35.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588503724999999, 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:35.814 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:35.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:35.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.588465804999998, 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:35.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:35.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:35.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:35.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:35.824 INFO:teuthology.orchestra.run.smithi081.stdout:4253 trunc from 0xe15f3b3 to 0x5a4dbf8 2024-09-18T00:32:35.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:35.829 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:35.823+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:35.829 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:35.829 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:35.831 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:35.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-18T00:32:35.832 INFO:teuthology.orchestra.run.smithi081.stdout:4255 write 0x28135ca thru 0x281d0f0 (0x9b27 bytes) 2024-09-18T00:32:35.832 INFO:teuthology.orchestra.run.smithi081.stdout:4256 trunc from 0x5a4dbf8 to 0x7be7029 2024-09-18T00:32:35.832 INFO:teuthology.orchestra.run.smithi081.stdout:4257 writesame 0x193f49b thru 0x193f6d8 data_size 0x7(0x23e bytes) 2024-09-18T00:32:35.832 INFO:teuthology.orchestra.run.smithi081.stdout:4259 trunc from 0x7be7029 to 0x2b8d8f 2024-09-18T00:32:35.832 INFO:teuthology.orchestra.run.smithi081.stdout:4261 writesame 0xb6c7975 thru 0xb6d48f0 data_size 0x62(0xcf7c bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4262 read 0x36cae71 thru 0x36cf72f (0x48bf bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4266 writesame 0x574fd4f thru 0x575913e data_size 0x18(0x93f0 bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4267 read 0xad897a2 thru 0xad92f70 (0x97cf bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4269 write 0x3200681 thru 0x320864d (0x7fcd bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4271 read 0xb57ba6b thru 0xb57c966 (0xefc bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4273 read 0x6d6fa34 thru 0x6d78fcf (0x959c bytes) 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.833 INFO:teuthology.orchestra.run.smithi081.stdout:4278 trunc from 0xb6d48f1 to 0x231ad8a 2024-09-18T00:32:35.837 INFO:teuthology.orchestra.run.smithi081.stdout:4279 read 0x53b65d thru 0x545870 (0xa214 bytes) 2024-09-18T00:32:35.839 INFO:teuthology.orchestra.run.smithi081.stdout:4280 write 0x116375d thru 0x1172597 (0xee3b bytes) 2024-09-18T00:32:35.840 INFO:teuthology.orchestra.run.smithi081.stdout:4283 read 0x1c4fd20 thru 0x1c5ec82 (0xef63 bytes) 2024-09-18T00:32:35.850 INFO:teuthology.orchestra.run.smithi081.stdout:4284 trunc from 0x231ad8a to 0xaeb0510 2024-09-18T00:32:35.856 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.856 INFO:teuthology.orchestra.run.smithi081.stdout:4286 writesame 0x1ffc84 thru 0x2099a7 data_size 0x59(0x9d24 bytes) 2024-09-18T00:32:35.860 INFO:teuthology.orchestra.run.smithi081.stdout:4287 read 0x457d43e thru 0x4587be4 (0xa7a7 bytes) 2024-09-18T00:32:35.870 INFO:teuthology.orchestra.run.smithi081.stdout:4289 write 0xe1fc08e thru 0xe20a0d7 (0xe04a bytes) 2024-09-18T00:32:35.889 INFO:teuthology.orchestra.run.smithi081.stdout:4290 trunc from 0xe20a0d8 to 0x14a0158 2024-09-18T00:32:35.902 INFO:teuthology.orchestra.run.smithi081.stdout:4291 read 0x145483 thru 0x14fcba (0xa838 bytes) 2024-09-18T00:32:35.903 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:35.916 INFO:teuthology.orchestra.run.smithi081.stdout:4293 write 0x80e85ae thru 0x80e8690 (0xe3 bytes) 2024-09-18T00:32:35.920 INFO:teuthology.orchestra.run.smithi081.stdout:4294 read 0x2d7019f thru 0x2d77d91 (0x7bf3 bytes) 2024-09-18T00:32:35.920 INFO:teuthology.orchestra.run.smithi081.stdout:4295 read 0x76a0b95 thru 0x76aa59b (0x9a07 bytes) 2024-09-18T00:32:35.920 INFO:teuthology.orchestra.run.smithi081.stdout:4296 read 0x420a807 thru 0x420ad6f (0x569 bytes) 2024-09-18T00:32:35.924 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:35.923+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:35.927 INFO:teuthology.orchestra.run.smithi081.stdout:4298 trunc from 0x80e8691 to 0xd10a0ad 2024-09-18T00:32:35.933 INFO:teuthology.orchestra.run.smithi081.stdout:4299 punch from 0xc191b5a to 0xc19ce4a, (0xb2f0 bytes) 2024-09-18T00:32:35.933 INFO:teuthology.orchestra.run.smithi081.stdout:4300 read 0xb672793 thru 0xb681f46 (0xf7b4 bytes) 2024-09-18T00:32:35.933 INFO:teuthology.orchestra.run.smithi081.stdout:4301 write 0x5e4cfa4 thru 0x5e5bb49 (0xeba6 bytes) 2024-09-18T00:32:35.935 INFO:teuthology.orchestra.run.smithi081.stdout:4302 read 0x4939d3f thru 0x49443a9 (0xa66b bytes) 2024-09-18T00:32:35.935 INFO:teuthology.orchestra.run.smithi081.stdout:4303 read 0x4701b60 thru 0x470fc0b (0xe0ac bytes) 2024-09-18T00:32:35.936 INFO:teuthology.orchestra.run.smithi081.stdout:4304 read 0xbd27704 thru 0xbd3528a (0xdb87 bytes) 2024-09-18T00:32:35.942 INFO:teuthology.orchestra.run.smithi081.stdout:4305 write 0xdeeb67a thru 0xdef34d1 (0x7e58 bytes) 2024-09-18T00:32:35.965 INFO:teuthology.orchestra.run.smithi081.stdout:4306 trunc from 0xdef34d2 to 0x81af10 2024-09-18T00:32:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:35.988 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:35.990 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:35.990 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:35.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-18T00:32:36.004 INFO:teuthology.orchestra.run.smithi081.stdout:4307 writesame 0xde20352 thru 0xde2d82b data_size 0x5(0xd4da bytes) 2024-09-18T00:32:36.004 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:36.004 INFO:teuthology.orchestra.run.smithi081.stdout:4309 punch from 0x9364bf7 to 0x9367751, (0x2b5a bytes) 2024-09-18T00:32:36.004 INFO:teuthology.orchestra.run.smithi081.stdout:4310 read 0x4b70d83 thru 0x4b75108 (0x4386 bytes) 2024-09-18T00:32:36.018 INFO:teuthology.orchestra.run.smithi081.stdout:4312 trunc from 0xde2d82c to 0x2086726 2024-09-18T00:32:36.025 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:36.024+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:36.027 INFO:teuthology.orchestra.run.smithi081.stdout:4313 punch from 0x1c2ccf to 0x1c747c, (0x47ad bytes) 2024-09-18T00:32:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:4315 trunc from 0x2086726 to 0x35d10e3 2024-09-18T00:32:36.051 INFO:teuthology.orchestra.run.smithi081.stdout:4316 write 0xd3a63be thru 0xd3ad24d (0x6e90 bytes) 2024-09-18T00:32:36.054 INFO:teuthology.orchestra.run.smithi081.stdout:4319 read 0x9f42e06 thru 0x9f5118a (0xe385 bytes) 2024-09-18T00:32:36.057 INFO:teuthology.orchestra.run.smithi081.stdout:4321 trunc from 0xd3ad24e to 0xae2e3c6 2024-09-18T00:32:36.064 INFO:teuthology.orchestra.run.smithi081.stdout:4322 write 0x2517ec3 thru 0x2518fbb (0x10f9 bytes) 2024-09-18T00:32:36.065 INFO:teuthology.orchestra.run.smithi081.stdout:4323 writesame 0x601fb1 thru 0x60453c data_size 0x36(0x258c bytes) 2024-09-18T00:32:36.076 INFO:teuthology.orchestra.run.smithi081.stdout:4324 writesame 0xdd5233b thru 0xdd575dd data_size 0x1(0x52a3 bytes) 2024-09-18T00:32:36.076 INFO:teuthology.orchestra.run.smithi081.stdout:4326 write 0x90a48fd thru 0x90a6821 (0x1f25 bytes) 2024-09-18T00:32:36.092 INFO:teuthology.orchestra.run.smithi081.stdout:4328 trunc from 0xdd575de to 0x345384f 2024-09-18T00:32:36.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:32:36.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:36.115 INFO:teuthology.orchestra.run.smithi081.stdout:4329 trunc from 0x345384f to 0x1ab5a55 2024-09-18T00:32:36.126 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:36.125+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:36.138 INFO:teuthology.orchestra.run.smithi081.stdout:4330 write 0x450e37f thru 0x45195c1 (0xb243 bytes) 2024-09-18T00:32:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:36.142 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:36.143 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:36.143 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:36.152 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:36.157 INFO:teuthology.orchestra.run.smithi081.stdout:4331 writesame 0xbc8aa8a thru 0xbc8d197 data_size 0x1(0x270e bytes) 2024-09-18T00:32:36.158 INFO:teuthology.orchestra.run.smithi081.stdout:4334 read 0x8bc2345 thru 0x8bcf0c1 (0xcd7d bytes) 2024-09-18T00:32:36.158 INFO:teuthology.orchestra.run.smithi081.stdout:4336 write 0x1cd2c96 thru 0x1cde09e (0xb409 bytes) 2024-09-18T00:32:36.159 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:36.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:36.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-18T00:32:36.160 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:36.165 INFO:teuthology.orchestra.run.smithi081.stdout:4338 trunc from 0xbc8d198 to 0x6a41fa9 2024-09-18T00:32:36.189 INFO:teuthology.orchestra.run.smithi081.stdout:4339 write 0xbb1ce5c thru 0xbb2c15a (0xf2ff bytes) 2024-09-18T00:32:36.199 INFO:teuthology.orchestra.run.smithi081.stdout:4340 write 0xcc00ee4 thru 0xcc0947b (0x8598 bytes) 2024-09-18T00:32:36.201 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:36.201 INFO:teuthology.orchestra.run.smithi081.stdout:4344 read 0x23b120f thru 0x23be10b (0xcefd bytes) 2024-09-18T00:32:36.202 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:36.202 INFO:teuthology.orchestra.run.smithi081.stdout:4346 read 0x7b8e238 thru 0x7b8fc39 (0x1a02 bytes) 2024-09-18T00:32:36.202 INFO:teuthology.orchestra.run.smithi081.stdout:4348 punch from 0x442bcea to 0x4435964, (0x9c7a bytes) 2024-09-18T00:32:36.202 INFO:teuthology.orchestra.run.smithi081.stdout:4349 read 0x4fdc577 thru 0x4fe7ee1 (0xb96b bytes) 2024-09-18T00:32:36.210 INFO:teuthology.orchestra.run.smithi081.stdout:4350 write 0xe29dd30 thru 0xe2a5448 (0x7719 bytes) 2024-09-18T00:32:36.217 INFO:teuthology.orchestra.run.smithi081.stdout:4351 read 0xdeee253 thru 0xdef97ae (0xb55c bytes) 2024-09-18T00:32:36.218 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:36.218 INFO:teuthology.orchestra.run.smithi081.stdout:4353 read 0xc7e27f1 thru 0xc7e4b43 (0x2353 bytes) 2024-09-18T00:32:36.218 INFO:teuthology.orchestra.run.smithi081.stdout:4355 write 0x4962a3 thru 0x49a50d (0x426b bytes) 2024-09-18T00:32:36.220 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:36.220 INFO:teuthology.orchestra.run.smithi081.stdout:4357 writesame 0x3e8d8f6 thru 0x3e96280 data_size 0x21(0x898b bytes) 2024-09-18T00:32:36.223 INFO:teuthology.orchestra.run.smithi081.stdout:4359 read 0x77ecd1 thru 0x78e5b2 (0xf8e2 bytes) 2024-09-18T00:32:36.224 INFO:teuthology.orchestra.run.smithi081.stdout:4360 clone 32 order 20 su 4096 sc 11 2024-09-18T00:32:36.237 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:36.235+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:36.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:36.271 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:36.289 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:36.299 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:36.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:36.299 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:36.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.299 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.496103128000001, 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:36.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:36.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:36.303 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.494172685000002, 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.304 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.494154344999998, 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.308 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:36.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:36.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.492563623999999, 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:36.313 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:36.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:36.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.492520390999999, 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.318 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.492322244, 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.322 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:36.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.492167852000001, 2024-09-18T00:32:36.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.327 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:36.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:36.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.491954106999998, 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.331 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:36.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.491755712, 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:36.335 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:36.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.491394864, 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:36.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:36.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.488113865999999, 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:36.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.488094691000001, 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.348 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.352 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.486235587000003, 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:36.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:36.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.48621069, 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.357 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:36.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.486190184999998, 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:36.361 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.365 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.486171431000002, 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:36.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:36.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.484151150000002, 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.370 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.484132563999999, 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.374 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.483296651000003, 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 43.478121485000003, 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:36.388 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:36.388 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:36.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:36.390 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:36.387+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:36.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:36.390 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:36.391 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:36.392 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:36.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-18T00:32:36.392 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:36.392 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:36.489 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:36.487+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:36.534 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:36.534 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:36.543 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:36.546 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:36.563 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:36.563 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:36.568 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:36.570 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:36.571 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:36.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-18T00:32:36.580 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:36.580 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:36.591 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:36.590+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:36.654 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:36.700 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:36.698+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:36.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:36.713 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:36.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-18T00:32:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:36.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:36.790 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:36.789+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:32:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:32:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:32:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:32:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:32:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:32:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:32:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:32:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:32:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:32:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:32:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:32:36.847 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:32:36.847 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:32:36.892 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:36.890+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:36.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:36.992 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:36.991+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:32:37.093 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:37.092+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:37.159 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone31 from 0xe2a5449 (overlap 0x2b8d8f) to 0x27329a 2024-09-18T00:32:37.195 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:37.193+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:37.244 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-18T00:32:37.250 INFO:teuthology.orchestra.run.smithi081.stdout:4361 read 0xc529c3e thru 0xc533dfc (0xa1bf bytes) 2024-09-18T00:32:37.250 INFO:teuthology.orchestra.run.smithi081.stdout:4362 read 0xe16a3f5 thru 0xe16e0c2 (0x3cce bytes) 2024-09-18T00:32:37.251 INFO:teuthology.orchestra.run.smithi081.stdout:4364 read 0x29bcc47 thru 0x29bfe97 (0x3251 bytes) 2024-09-18T00:32:37.252 INFO:teuthology.orchestra.run.smithi081.stdout:4365 write 0xda6a14b thru 0xda79e38 (0xfcee bytes) 2024-09-18T00:32:37.261 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.261 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:37.293 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:37.296 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:37.294+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:37.302 INFO:teuthology.orchestra.run.smithi081.stdout:4367 trunc from 0xe2a5449 to 0x732ddd2 2024-09-18T00:32:37.397 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:37.396+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:37.420 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.421 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:37.498 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:37.497+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:37.576 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.576 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:37.630 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:37.629+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:37.636 INFO:teuthology.orchestra.run.smithi081.stdout:4368 writesame 0x372cfc8 thru 0x3736284 data_size 0xb(0x92bd bytes) 2024-09-18T00:32:37.704 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:37.699+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:37.723 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.723 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:37.755 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:37.755 INFO:teuthology.orchestra.run.smithi081.stdout:4370 write 0x3157ea6 thru 0x315ad07 (0x2e62 bytes) 2024-09-18T00:32:37.801 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:37.799+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:37.807 INFO:teuthology.orchestra.run.smithi081.stdout:4371 read 0x1317ef4 thru 0x13208e4 (0x89f1 bytes) 2024-09-18T00:32:37.809 INFO:teuthology.orchestra.run.smithi081.stdout:4372 read 0xfee245 thru 0xff75a8 (0x9364 bytes) 2024-09-18T00:32:37.811 INFO:teuthology.orchestra.run.smithi081.stdout:4373 write 0x3ca036b thru 0x3ca689e (0x6534 bytes) 2024-09-18T00:32:37.813 INFO:teuthology.orchestra.run.smithi081.stdout:4374 read 0x5ef97f4 thru 0x5f01618 (0x7e25 bytes) 2024-09-18T00:32:37.821 INFO:teuthology.orchestra.run.smithi081.stdout:4375 writesame 0x852172e thru 0x8522170 data_size 0x1(0xa43 bytes) 2024-09-18T00:32:37.833 INFO:teuthology.orchestra.run.smithi081.stdout:4376 write 0xe0f1e81 thru 0xe0f205b (0x1db bytes) 2024-09-18T00:32:37.846 INFO:teuthology.orchestra.run.smithi081.stdout:4377 trunc from 0xe0f205c to 0x7c9f549 2024-09-18T00:32:37.856 INFO:teuthology.orchestra.run.smithi081.stdout:4378 write 0x15118ca thru 0x1517c68 (0x639f bytes) 2024-09-18T00:32:37.885 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:37.885 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:37.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:37.902 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:37.900+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:37.951 INFO:teuthology.orchestra.run.smithi081.stdout:4379 trunc from 0x7c9f549 to 0xe760903 2024-09-18T00:32:37.963 INFO:teuthology.orchestra.run.smithi081.stdout:4381 trunc from 0xe760903 to 0x896e4e2 2024-09-18T00:32:37.973 INFO:teuthology.orchestra.run.smithi081.stdout:4382 trunc from 0x896e4e2 to 0x66724ae 2024-09-18T00:32:38.003 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:38.001+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:38.073 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:38.073 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:38.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:38.088 INFO:teuthology.orchestra.run.smithi081.stdout:4384 punch from 0x10f8b5d to 0x10fc12f, (0x35d2 bytes) 2024-09-18T00:32:38.088 INFO:teuthology.orchestra.run.smithi081.stdout:4386 read 0x307148c thru 0x3076aeb (0x5660 bytes) 2024-09-18T00:32:38.088 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.090 INFO:teuthology.orchestra.run.smithi081.stdout:4388 write 0x433061e thru 0x4338bb2 (0x8595 bytes) 2024-09-18T00:32:38.107 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:38.103+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:38.205 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:38.204+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:38.216 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:38.216 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:38.216 INFO:teuthology.orchestra.run.smithi081.stdout:4390 punch from 0x54fa9f2 to 0x5503338, (0x8946 bytes) 2024-09-18T00:32:38.217 INFO:teuthology.orchestra.run.smithi081.stdout:4391 read 0x1b9eb21 thru 0x1baa099 (0xb579 bytes) 2024-09-18T00:32:38.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:38.233 INFO:teuthology.orchestra.run.smithi081.stdout:4392 write 0xeae4d19 thru 0xeaef5e4 (0xa8cc bytes) 2024-09-18T00:32:38.249 INFO:teuthology.orchestra.run.smithi081.stdout:4393 writesame 0x9a50774 thru 0x9a5ee9f data_size 0x6e(0xe72c bytes) 2024-09-18T00:32:38.263 INFO:teuthology.orchestra.run.smithi081.stdout:4394 write 0xd6097ae thru 0xd613930 (0xa183 bytes) 2024-09-18T00:32:38.278 INFO:teuthology.orchestra.run.smithi081.stdout:4395 punch from 0x4db2e70 to 0x4dbecc3, (0xbe53 bytes) 2024-09-18T00:32:38.278 INFO:teuthology.orchestra.run.smithi081.stdout:4396 writesame 0x1ada236 thru 0x1adb697 data_size 0x1(0x1462 bytes) 2024-09-18T00:32:38.305 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:38.304+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:38.309 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.310 INFO:teuthology.orchestra.run.smithi081.stdout:4398 punch from 0x774f611 to 0x775972e, (0xa11d bytes) 2024-09-18T00:32:38.310 INFO:teuthology.orchestra.run.smithi081.stdout:4399 read 0x2491f19 thru 0x24a01ff (0xe2e7 bytes) 2024-09-18T00:32:38.323 INFO:teuthology.orchestra.run.smithi081.stdout:4401 trunc from 0xeaef5e5 to 0x71338de 2024-09-18T00:32:38.345 INFO:teuthology.orchestra.run.smithi081.stdout:4402 writesame 0x42522c2 thru 0x4252b2c data_size 0x1(0x86b bytes) 2024-09-18T00:32:38.356 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:38.356 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:38.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:38.376 INFO:teuthology.orchestra.run.smithi081.stdout:4403 writesame 0xeb93a66 thru 0xeb9c4c1 data_size 0x8c(0x8a5c bytes) 2024-09-18T00:32:38.376 INFO:teuthology.orchestra.run.smithi081.stdout:4404 write 0x96219a9 thru 0x9624423 (0x2a7b bytes) 2024-09-18T00:32:38.383 INFO:teuthology.orchestra.run.smithi081.stdout:4406 write 0xd50f08c thru 0xd50fa66 (0x9db bytes) 2024-09-18T00:32:38.386 INFO:teuthology.orchestra.run.smithi081.stdout:4407 read 0xcb9a8fe thru 0xcba8c2d (0xe330 bytes) 2024-09-18T00:32:38.386 INFO:teuthology.orchestra.run.smithi081.stdout:4408 read 0x58279a7 thru 0x58284a0 (0xafa bytes) 2024-09-18T00:32:38.386 INFO:teuthology.orchestra.run.smithi081.stdout:4409 writesame 0xd34f7d9 thru 0xd358850 data_size 0x45(0x9078 bytes) 2024-09-18T00:32:38.397 INFO:teuthology.orchestra.run.smithi081.stdout:4410 punch from 0x4408117 to 0x440bac6, (0x39af bytes) 2024-09-18T00:32:38.397 INFO:teuthology.orchestra.run.smithi081.stdout:4413 read 0xce5a753 thru 0xce65cbd (0xb56b bytes) 2024-09-18T00:32:38.397 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.397 INFO:teuthology.orchestra.run.smithi081.stdout:4416 write 0xcd6bee3 thru 0xcd7448d (0x85ab bytes) 2024-09-18T00:32:38.406 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:38.404+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:38.411 INFO:teuthology.orchestra.run.smithi081.stdout:4417 trunc from 0xeb9c4c2 to 0xac033f3 2024-09-18T00:32:38.427 INFO:teuthology.orchestra.run.smithi081.stdout:4418 writesame 0xc652e0 thru 0xc714b5 data_size 0x2b(0xc1d6 bytes) 2024-09-18T00:32:38.493 INFO:teuthology.orchestra.run.smithi081.stdout:4419 trunc from 0xac033f3 to 0xc4c15d7 2024-09-18T00:32:38.498 INFO:teuthology.orchestra.run.smithi081.stdout:4421 trunc from 0xc4c15d7 to 0xdf9eb04 2024-09-18T00:32:38.501 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:38.501 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:38.503 INFO:teuthology.orchestra.run.smithi081.stdout:4422 write 0x999f427 thru 0x99a72f2 (0x7ecc bytes) 2024-09-18T00:32:38.506 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:38.505+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:38.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:38.516 INFO:teuthology.orchestra.run.smithi081.stdout:4423 punch from 0x771c078 to 0x771ff17, (0x3e9f bytes) 2024-09-18T00:32:38.517 INFO:teuthology.orchestra.run.smithi081.stdout:4424 writesame 0xb22a806 thru 0xb239e64 data_size 0x1(0xf65f bytes) 2024-09-18T00:32:38.557 INFO:teuthology.orchestra.run.smithi081.stdout:4425 write 0x629a1f9 thru 0x629f97c (0x5784 bytes) 2024-09-18T00:32:38.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:38.607 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:38.606+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:38.629 INFO:teuthology.orchestra.run.smithi081.stdout:4426 write 0xb50d928 thru 0xb514453 (0x6b2c bytes) 2024-09-18T00:32:38.635 INFO:teuthology.orchestra.run.smithi081.stdout:4427 read 0x9e8dcea thru 0x9e9d3fd (0xf714 bytes) 2024-09-18T00:32:38.635 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.635 INFO:teuthology.orchestra.run.smithi081.stdout:4430 write 0xb37f752 thru 0xb3829f1 (0x32a0 bytes) 2024-09-18T00:32:38.640 INFO:teuthology.orchestra.run.smithi081.stdout:4431 write 0x3706b76 thru 0x37105f4 (0x9a7f bytes) 2024-09-18T00:32:38.643 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:38.643 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:38.646 INFO:teuthology.orchestra.run.smithi081.stdout:4432 write 0x159bdb2 thru 0x15a2806 (0x6a55 bytes) 2024-09-18T00:32:38.650 INFO:teuthology.orchestra.run.smithi081.stdout:4433 writesame 0x4d87dc thru 0x4da65d data_size 0x37(0x1e82 bytes) 2024-09-18T00:32:38.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:38.691 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.691 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.691 INFO:teuthology.orchestra.run.smithi081.stdout:4437 write 0xae9ca8 thru 0xaf1d6b (0x80c4 bytes) 2024-09-18T00:32:38.709 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:38.707+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:38.754 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:38.779 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:38.782 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:38.784 INFO:teuthology.orchestra.run.smithi081.stdout:4439 trunc from 0xdf9eb04 to 0xce228ee 2024-09-18T00:32:38.793 INFO:teuthology.orchestra.run.smithi081.stdout:4442 writesame 0x6782410 thru 0x67918d6 data_size 0x1(0xf4c7 bytes) 2024-09-18T00:32:38.798 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:38.798 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:38.809 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:38.808+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:38.818 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:38.830 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:38.830 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:38.830 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:38.830 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:38.830 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:38.838 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:38.838 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:38.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:38.846 INFO:teuthology.orchestra.run.smithi081.stdout:4444 write 0x9fd12ca thru 0x9fdb0c0 (0x9df7 bytes) 2024-09-18T00:32:38.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:38.859 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:38.862 INFO:teuthology.orchestra.run.smithi081.stdout:4446 read 0x4764d0c thru 0x4766659 (0x194e bytes) 2024-09-18T00:32:38.862 INFO:teuthology.orchestra.run.smithi081.stdout:4447 read 0x54772d2 thru 0x54866bb (0xf3ea bytes) 2024-09-18T00:32:38.878 INFO:teuthology.orchestra.run.smithi081.stdout:4449 trunc from 0xce228ee to 0x1794326 2024-09-18T00:32:38.878 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:38.903 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:38.912 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:38.911+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.013818014999998, 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.013438358000002, 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.012609175000001, 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.005824572000002, 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.005804105999999, 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.005780016999999, 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.003934055000002, 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.003870235999997, 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.003841356000002, 2024-09-18T00:32:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.003816380000004, 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.003797327999997, 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.001848531, 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.001826074, 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.001797633999999, 2024-09-18T00:32:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.001775326000001, 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.001754874, 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.000925424999998, 2024-09-18T00:32:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:39.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.000884499999998, 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:39.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.000843252999999, 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:39.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.000820588000003, 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:39.071 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:39.072 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:39.073 INFO:teuthology.orchestra.run.smithi081.stdout:4450 trunc from 0x1794326 to 0x37c2cbd 2024-09-18T00:32:39.073 INFO:teuthology.orchestra.run.smithi081.stdout:4451 writesame 0x25f40e2 thru 0x25ff1f7 data_size 0x13(0xb116 bytes) 2024-09-18T00:32:39.073 INFO:teuthology.orchestra.run.smithi081.stdout:4452 punch from 0x20d98c5 to 0x20e07ca, (0x6f05 bytes) 2024-09-18T00:32:39.073 INFO:teuthology.orchestra.run.smithi081.stdout:4453 clone 33 order 19 su 65536 sc 7 2024-09-18T00:32:39.074 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:39.070+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:39.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:32:39.173 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:39.171+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:39.180 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone32 from 0x37c2cbd (overlap 0x1794326) to 0x712dbe 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:97653 3.9 3:92bd3086:::rbd_data.1197e53ff0cc.0000000000000012:head [stat out=16b,delete] snapc 23=[23] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:39.182456+0000", 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.00049293600000000003, 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00051804499999999996, 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.184 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "waiting for sub ops", 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 97653 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182456+0000", 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182456+0000", 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182457+0000", 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5099999999999998e-07 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182462+0000", 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9099999999999996e-06 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182474+0000", 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2561999999999999e-05 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182482+0000", 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0669999999999992e-06 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182551+0000", 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8521000000000003e-05 2024-09-18T00:32:39.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182637+0000", 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6706000000000006e-05 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 2", 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182816+0000", 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017811199999999999 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_repop(client.4503.0:97649 3.a e69/23 3:50f2f80d:::rbd_data.1197e53ff0cc.000000000000000e:head v 69'227, mlcod=68'224)", 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:39.182830+0000", 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.00011847, 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000219111, 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182830+0000", 2024-09-18T00:32:39.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182830+0000", 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182831+0000", 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2699999999999998e-07 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182838+0000", 2024-09-18T00:32:39.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.233e-06 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182849+0000", 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0832999999999999e-05 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182856+0000", 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1169999999999998e-06 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182958+0000", 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000101802 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182977+0000", 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.876e-05 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_repop(client.4503.0:97646 3.1b e69/23 3:dcd8cfde:::rbd_data.1197e53ff0cc.000000000000000b:head v 69'703, mlcod=68'700)", 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:39.182888+0000", 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 6.0389000000000001e-05, 2024-09-18T00:32:39.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00021441900000000001, 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182888+0000", 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182888+0000", 2024-09-18T00:32:39.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182889+0000", 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9100000000000004e-07 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182896+0000", 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8410000000000002e-06 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.194 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182904+0000", 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6769999999999995e-06 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182909+0000", 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6869999999999999e-06 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.182985+0000", 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5442e-05 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:39.183002+0000", 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7617000000000001e-05 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 3 2024-09-18T00:32:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:39.197 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:39.274 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:39.272+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:39.282 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-18T00:32:39.289 INFO:teuthology.orchestra.run.smithi081.stdout:4454 writesame 0xe5a172 thru 0xe680cb data_size 0x2e(0xdf5a bytes) 2024-09-18T00:32:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:4456 write 0xc024578 thru 0xc0279e4 (0x346d bytes) 2024-09-18T00:32:39.325 INFO:teuthology.orchestra.run.smithi081.stdout:4457 writesame 0x1904bfa thru 0x1906587 data_size 0x1(0x198e bytes) 2024-09-18T00:32:39.336 INFO:teuthology.orchestra.run.smithi081.stdout:4458 write 0x8df578f thru 0x8dff82b (0xa09d bytes) 2024-09-18T00:32:39.340 INFO:teuthology.orchestra.run.smithi081.stdout:4460 punch from 0x2a1095c to 0x2a1c3a5, (0xba49 bytes) 2024-09-18T00:32:39.340 INFO:teuthology.orchestra.run.smithi081.stdout:4463 write 0x6560e0e thru 0x656e9fe (0xdbf1 bytes) 2024-09-18T00:32:39.345 INFO:teuthology.orchestra.run.smithi081.stdout:4464 writesame 0x533becd thru 0x53432cf data_size 0x1(0x7403 bytes) 2024-09-18T00:32:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:39.348 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:39.348 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:39.348 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:39.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:39.369 INFO:teuthology.orchestra.run.smithi081.stdout:4465 punch from 0x7478d5e to 0x747b1ce, (0x2470 bytes) 2024-09-18T00:32:39.369 INFO:teuthology.orchestra.run.smithi081.stdout:4466 read 0x28720da thru 0x287da14 (0xb93b bytes) 2024-09-18T00:32:39.369 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:39.370 INFO:teuthology.orchestra.run.smithi081.stdout:4470 write 0x9cc456d thru 0x9cc6352 (0x1de6 bytes) 2024-09-18T00:32:39.373 INFO:teuthology.orchestra.run.smithi081.stdout:4471 clone 34 order 25 su 8388608 sc 10 2024-09-18T00:32:39.375 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:39.373+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.462 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.315085103000001, 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:39.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.315064639999999, 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:39.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.315045245, 2024-09-18T00:32:39.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:39.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:39.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.31502609, 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.476 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.315006660000002, 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.480 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:39.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:39.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314987004999999, 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.485 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:39.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:39.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314968011000001, 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.489 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:39.493 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314929085999999, 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:39.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:39.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314909006000001, 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:39.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314889262000001, 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.502 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:39.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314869482999999, 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.507 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:39.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.511 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314849894999998, 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:39.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:39.517 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314820429000001, 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:39.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314790095999999, 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:39.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.526 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314763366000001, 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:39.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:39.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:39.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314735969000001, 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:39.535 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314710326, 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:39.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:39.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.31468542, 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:39.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:39.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314651249000001, 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:39.544 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:39.548 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.314613329, 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:39.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:39.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:39.553 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:39.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:39.555 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:39.553+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:39.654 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:39.653+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:39.698 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:39.698 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:39.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:39.790 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:39.789+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:39.850 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:39.850 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:39.850 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:39.856 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:39.854+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:39.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:39.957 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:39.955+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.199562315999998, 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:40.003 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:40.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:40.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:40.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:40.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.197631872999999, 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:40.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:40.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.012 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.197613533000002, 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:40.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.196022812000002, 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.017 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:40.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:40.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.195979579000003, 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:40.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:40.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.195781431999997, 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.028 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.195627039999998, 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.033 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:40.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.037 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.195413295000002, 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:40.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.195214900000003, 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.194854051999997, 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.191573054000003, 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.191553878999997, 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.189694775, 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.189669877999997, 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.189649373000002, 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.189630618999999, 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.187610337999999, 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.187591752000003, 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.186755839, 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 47.181580672999999, 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:40.098 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:40.099 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:40.096+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:40.108 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:32:40.199 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:40.197+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:40.200 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone33 from 0xc0279e5 (overlap 0x37c2cbd) to 0x27085b7 2024-09-18T00:32:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:40.268 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:40.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.268 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99200 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.268 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257089+0000", 2024-09-18T00:32:40.268 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0063054000000000001, 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0063309769999999998, 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99200 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257089+0000", 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257089+0000", 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257090+0000", 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257092+0000", 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.086e-06 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257097+0000", 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6659999999999996e-06 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257102+0000", 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6739999999999996e-06 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.271 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99201 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257108+0000", 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0062864849999999996, 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0063747409999999997, 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.272 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99201 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257108+0000", 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257108+0000", 2024-09-18T00:32:40.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257109+0000", 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257110+0000", 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8279999999999999e-06 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257116+0000", 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.84e-06 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257121+0000", 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7600000000000002e-06 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.275 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99202 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257127+0000", 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0062677130000000003, 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0064122789999999999, 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99202 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.276 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257127+0000", 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257127+0000", 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257127+0000", 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257129+0000", 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9290000000000001e-06 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257135+0000", 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7620000000000001e-06 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257140+0000", 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6890000000000003e-06 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99203 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257145+0000", 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0062495049999999998, 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0064531090000000003, 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.279 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99203 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257145+0000", 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257145+0000", 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257146+0000", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7e-07 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257147+0000", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.781e-06 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257153+0000", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8900000000000004e-06 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257158+0000", 2024-09-18T00:32:40.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6099999999999999e-06 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99204 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257163+0000", 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0062312720000000004, 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0064882730000000001, 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.283 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99204 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257163+0000", 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257163+0000", 2024-09-18T00:32:40.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257164+0000", 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257166+0000", 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.897e-06 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257171+0000", 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7690000000000002e-06 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257176+0000", 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6299999999999997e-06 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.286 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99205 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257182+0000", 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0062130830000000003, 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0065249660000000001, 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99205 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257182+0000", 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257182+0000", 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257182+0000", 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3299999999999998e-07 2024-09-18T00:32:40.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257184+0000", 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.796e-06 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257191+0000", 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3100000000000003e-06 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257196+0000", 2024-09-18T00:32:40.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7570000000000004e-06 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99206 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257201+0000", 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0061932530000000001, 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0065576970000000004, 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.290 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99206 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257201+0000", 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257201+0000", 2024-09-18T00:32:40.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257202+0000", 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257204+0000", 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.812e-06 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.292 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257209+0000", 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8749999999999997e-06 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257214+0000", 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.561e-06 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.293 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99207 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.257221+0000", 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.006173535, 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.006591398, 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99207 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257221+0000", 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257221+0000", 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257221+0000", 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2300000000000002e-07 2024-09-18T00:32:40.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257223+0000", 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.95e-06 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257229+0000", 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.587e-06 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.257234+0000", 2024-09-18T00:32:40.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2870000000000004e-06 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99288 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259496+0000", 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0038990930000000002, 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0043706609999999996, 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99288 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259496+0000", 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259496+0000", 2024-09-18T00:32:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259496+0000", 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2600000000000002e-07 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259501+0000", 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4750000000000004e-06 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259512+0000", 2024-09-18T00:32:40.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1742999999999999e-05 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259522+0000", 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3649999999999993e-06 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99289 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259534+0000", 2024-09-18T00:32:40.300 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0038602879999999999, 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0043947459999999997, 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99289 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259534+0000", 2024-09-18T00:32:40.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259534+0000", 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259535+0000", 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0900000000000001e-07 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259538+0000", 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9679999999999998e-06 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259545+0000", 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.182e-06 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259551+0000", 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4990000000000002e-06 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.303 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99290 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259559+0000", 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.003835598, 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0044236179999999998, 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.304 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99290 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259559+0000", 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259559+0000", 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.305 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259560+0000", 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0900000000000002e-07 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259562+0000", 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4279999999999999e-06 2024-09-18T00:32:40.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259568+0000", 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259573+0000", 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9280000000000001e-06 2024-09-18T00:32:40.307 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99291 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259581+0000", 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0038138220000000001, 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0044545929999999997, 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99291 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259581+0000", 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259581+0000", 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259581+0000", 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5699999999999998e-07 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259584+0000", 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259591+0000", 2024-09-18T00:32:40.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1300000000000003e-06 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259596+0000", 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.955e-06 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99292 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259602+0000", 2024-09-18T00:32:40.311 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0037927249999999998, 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0044856640000000003, 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99292 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259602+0000", 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259602+0000", 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259602+0000", 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.15e-07 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259605+0000", 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3599999999999999e-06 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259611+0000", 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7000000000000002e-06 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259617+0000", 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1479999999999997e-06 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99293 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259623+0000", 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0037717610000000002, 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0045170389999999996, 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.315 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99293 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259623+0000", 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259623+0000", 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259623+0000", 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9099999999999999e-07 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259625+0000", 2024-09-18T00:32:40.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0449999999999999e-06 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259632+0000", 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2530000000000001e-06 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259637+0000", 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9679999999999997e-06 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99294 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259643+0000", 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0037519290000000002, 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0045493069999999998, 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.319 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99294 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259643+0000", 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259643+0000", 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259643+0000", 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1899999999999998e-07 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259650+0000", 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7959999999999998e-06 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259657+0000", 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.635e-06 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259661+0000", 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8280000000000002e-06 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:99295 3.a 3.3af7c0ea (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:40.322 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:40.259670+0000", 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 0.0037246430000000001, 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0045753360000000002, 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "queued for pg", 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 99295 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.323 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259670+0000", 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259670+0000", 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259670+0000", 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1699999999999999e-07 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259673+0000", 2024-09-18T00:32:40.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2409999999999998e-06 2024-09-18T00:32:40.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259679+0000", 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3500000000000002e-06 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:40.259684+0000", 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0849999999999996e-06 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.329 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.330 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2024-09-18T00:32:40.330 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 16 2024-09-18T00:32:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:40.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:40.332 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:40.329+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:40.384 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-18T00:32:40.399 INFO:teuthology.orchestra.run.smithi081.stdout:4473 write 0xbae18b9 thru 0xbaebf3a (0xa682 bytes) 2024-09-18T00:32:40.432 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:40.431+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:40.459 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:40.465 INFO:teuthology.orchestra.run.smithi081.stdout:4476 trunc from 0xc0279e5 to 0x73e6b54 2024-09-18T00:32:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:40.514 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:40.514 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:40.514 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:40.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:40.573 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:40.571+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:40.634 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:40.633+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.332634183000003, 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.693 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:40.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:40.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.327285646, 2024-09-18T00:32:40.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:40.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.701 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.323545920999997, 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:40.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.323521552999999, 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:40.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:40.710 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.323508973000003, 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:40.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.714 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.323498696999998, 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.715 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.311644512999997, 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.719 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:40.723 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.311624143000003, 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:40.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.309664505999997, 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:40.728 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:40.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:40.732 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.309655237000001, 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.733 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:40.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:40.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:40.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:40.740 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.740 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.740 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.307641936000003, 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.741 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:40.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.307623775000003, 2024-09-18T00:32:40.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:40.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.749 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.305325891999999, 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:40.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:40.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:40.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.305285441999999, 2024-09-18T00:32:40.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:40.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:40.758 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.305189945999999, 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.759 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:40.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:40.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.303614220999997, 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:40.763 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:40.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.767 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.303593503000002, 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:40.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.303569969999998, 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.772 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:40.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:40.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.303547371999997, 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.777 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:40.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:40.781 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 48.301591815000002, 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:40.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:40.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:40.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:40.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:40.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:40.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:40.789 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:40.787+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:40.889 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:40.888+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:40.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:40.953 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:40.953 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:40.957 INFO:teuthology.orchestra.run.smithi081.stdout:4477 writesame 0xcdd1c11 thru 0xcde0c84 data_size 0x16(0xf074 bytes) 2024-09-18T00:32:40.958 INFO:teuthology.orchestra.run.smithi081.stdout:4478 write 0xc21555e thru 0xc21eee0 (0x9983 bytes) 2024-09-18T00:32:40.960 INFO:teuthology.orchestra.run.smithi081.stdout:4480 read 0x8dc8d99 thru 0x8dcbb02 (0x2d6a bytes) 2024-09-18T00:32:40.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:40.967 INFO:teuthology.orchestra.run.smithi081.stdout:4481 write 0xd91c337 thru 0xd9238d1 (0x759b bytes) 2024-09-18T00:32:40.969 INFO:teuthology.orchestra.run.smithi081.stdout:4483 read 0x744cbb7 thru 0x7457eff (0xb349 bytes) 2024-09-18T00:32:40.969 INFO:teuthology.orchestra.run.smithi081.stdout:4484 write 0x8180dec thru 0x8188971 (0x7b86 bytes) 2024-09-18T00:32:40.971 INFO:teuthology.orchestra.run.smithi081.stdout:4485 read 0x1187c8b thru 0x118e38f (0x6705 bytes) 2024-09-18T00:32:40.971 INFO:teuthology.orchestra.run.smithi081.stdout:4486 write 0xcc590b thru 0xcc8ed6 (0x35cc bytes) 2024-09-18T00:32:40.973 INFO:teuthology.orchestra.run.smithi081.stdout:4487 read 0x4785bdf thru 0x478881a (0x2c3c bytes) 2024-09-18T00:32:40.973 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:40.986 INFO:teuthology.orchestra.run.smithi081.stdout:4490 trunc from 0xd9238d2 to 0x303e337 2024-09-18T00:32:41.002 INFO:teuthology.orchestra.run.smithi081.stdout:4493 trunc from 0x303e337 to 0x675a3f4 2024-09-18T00:32:41.006 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:41.005+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:4494 read 0x2da87f8 thru 0x2db06ee (0x7ef7 bytes) 2024-09-18T00:32:41.008 INFO:teuthology.orchestra.run.smithi081.stdout:4495 clone 35 order 25 su 2097152 sc 9 2024-09-18T00:32:41.054 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:41.069 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:41.069 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:41.069 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:41.071 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:41.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:41.087 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:41.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:41.119 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:41.118+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:41.122 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:41.140 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:41.140 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:41.157 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:41.174 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:41.191 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:41.190+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:41.205 INFO:teuthology.orchestra.run.smithi081.stdout:leaving image image_client.0-clone34 intact 2024-09-18T00:32:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:41.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:41.292 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:41.291+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:41.346 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-18T00:32:41.348 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:41.348 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:41.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:41.402 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:41.401+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:41.495 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:41.493+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:41.576 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:41.576 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:41.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:41.629 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:41.628+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:41.673 INFO:teuthology.orchestra.run.smithi081.stdout:4496 read 0x6453d77 thru 0x645d362 (0x95ec bytes) 2024-09-18T00:32:41.675 INFO:teuthology.orchestra.run.smithi081.stdout:4497 writesame 0x39de0d thru 0x39eb4b data_size 0x1(0xd3f bytes) 2024-09-18T00:32:41.695 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:41.693+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:41.708 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:41.708 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:41.713 INFO:teuthology.orchestra.run.smithi081.stdout:4499 writesame 0x70624ac thru 0x7066b40 data_size 0x13(0x4695 bytes) 2024-09-18T00:32:41.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:41.731 INFO:teuthology.orchestra.run.smithi081.stdout:4500 write 0x2e26fd1 thru 0x2e2ea7a (0x7aaa bytes) 2024-09-18T00:32:41.765 INFO:teuthology.orchestra.run.smithi081.stdout:4501 writesame 0xb8515e0 thru 0xb857d52 data_size 0x1(0x6773 bytes) 2024-09-18T00:32:41.765 INFO:teuthology.orchestra.run.smithi081.stdout:4505 punch from 0x4d0ada4 to 0x4d0d639, (0x2895 bytes) 2024-09-18T00:32:41.765 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:41.773 INFO:teuthology.orchestra.run.smithi081.stdout:4507 write 0xd6714b4 thru 0xd679c30 (0x877d bytes) 2024-09-18T00:32:41.779 INFO:teuthology.orchestra.run.smithi081.stdout:4508 read 0xc82bcb4 thru 0xc83b448 (0xf795 bytes) 2024-09-18T00:32:41.780 INFO:teuthology.orchestra.run.smithi081.stdout:4509 read 0x5dc339c thru 0x5dc6705 (0x336a bytes) 2024-09-18T00:32:41.780 INFO:teuthology.orchestra.run.smithi081.stdout:4510 read 0x2a7530b thru 0x2a80705 (0xb3fb bytes) 2024-09-18T00:32:41.782 INFO:teuthology.orchestra.run.smithi081.stdout:4512 read 0x5b6190e thru 0x5b6eb6f (0xd262 bytes) 2024-09-18T00:32:41.782 INFO:teuthology.orchestra.run.smithi081.stdout:4514 read 0x65ae62e thru 0x65b7b7c (0x954f bytes) 2024-09-18T00:32:41.795 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:41.794+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:41.796 INFO:teuthology.orchestra.run.smithi081.stdout:4516 trunc from 0xd679c31 to 0x11a5714 2024-09-18T00:32:41.840 INFO:teuthology.orchestra.run.smithi081.stdout:4518 write 0xbbdacd3 thru 0xbbe9549 (0xe877 bytes) 2024-09-18T00:32:41.847 INFO:teuthology.orchestra.run.smithi081.stdout:4520 writesame 0xc0c435a thru 0xc0c4cfb data_size 0x9(0x9a2 bytes) 2024-09-18T00:32:41.848 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:41.848 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:41.848 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:32:41.848 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.007041 2024-09-18T00:32:41.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.007041254496165772 2024-09-18T00:32:41.856 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:41.856 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:41.858 INFO:teuthology.orchestra.run.smithi081.stdout:4522 trunc from 0xc0c4cfc to 0x34e4036 2024-09-18T00:32:41.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:41.879 INFO:teuthology.orchestra.run.smithi081.stdout:4523 writesame 0x8e482c1 thru 0x8e50519 data_size 0x31(0x8259 bytes) 2024-09-18T00:32:41.887 INFO:teuthology.orchestra.run.smithi081.stdout:4524 write 0xa0af87c thru 0xa0ba337 (0xaabc bytes) 2024-09-18T00:32:41.896 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:41.894+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:41.896 INFO:teuthology.orchestra.run.smithi081.stdout:4525 write 0xbadfe2d thru 0xbaed45f (0xd633 bytes) 2024-09-18T00:32:41.898 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:41.898 INFO:teuthology.orchestra.run.smithi081.stdout:4527 write 0x1407ecf thru 0x1417d36 (0xfe68 bytes) 2024-09-18T00:32:41.899 INFO:teuthology.orchestra.run.smithi081.stdout:4529 write 0xa262bd3 thru 0xa2638d3 (0xd01 bytes) 2024-09-18T00:32:41.903 INFO:teuthology.orchestra.run.smithi081.stdout:4530 trunc from 0xbaed460 to 0xdb9797f 2024-09-18T00:32:41.909 INFO:teuthology.orchestra.run.smithi081.stdout:4531 read 0x6ec3f23 thru 0x6ecd1aa (0x9288 bytes) 2024-09-18T00:32:41.909 INFO:teuthology.orchestra.run.smithi081.stdout:4533 read 0x767b714 thru 0x7683149 (0x7a36 bytes) 2024-09-18T00:32:41.910 INFO:teuthology.orchestra.run.smithi081.stdout:4534 read 0x286fc7f thru 0x287f607 (0xf989 bytes) 2024-09-18T00:32:41.924 INFO:teuthology.orchestra.run.smithi081.stdout:4535 trunc from 0xdb9797f to 0x24596c5 2024-09-18T00:32:41.952 INFO:teuthology.orchestra.run.smithi081.stdout:4536 write 0xe6086e8 thru 0xe610544 (0x7e5d bytes) 2024-09-18T00:32:41.953 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:41.953 INFO:teuthology.orchestra.run.smithi081.stdout:4539 read 0x8cba27 thru 0x8d8724 (0xccfe bytes) 2024-09-18T00:32:41.954 INFO:teuthology.orchestra.run.smithi081.stdout:4540 read 0x26009f6 thru 0x260d65a (0xcc65 bytes) 2024-09-18T00:32:41.954 INFO:teuthology.orchestra.run.smithi081.stdout:4543 read 0x2d97028 thru 0x2da3c99 (0xcc72 bytes) 2024-09-18T00:32:41.954 INFO:teuthology.orchestra.run.smithi081.stdout:4544 write 0x81ba03c thru 0x81bee7b (0x4e40 bytes) 2024-09-18T00:32:41.956 INFO:teuthology.orchestra.run.smithi081.stdout:4546 read 0x8b19ebc thru 0x8b21ee6 (0x802b bytes) 2024-09-18T00:32:41.956 INFO:teuthology.orchestra.run.smithi081.stdout:4548 read 0x45de815 thru 0x45e7a25 (0x9211 bytes) 2024-09-18T00:32:41.957 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:41.957 INFO:teuthology.orchestra.run.smithi081.stdout:4550 write 0xe2581a1 thru 0xe262791 (0xa5f1 bytes) 2024-09-18T00:32:41.958 INFO:teuthology.orchestra.run.smithi081.stdout:4551 read 0x75d6c6e thru 0x75deba2 (0x7f35 bytes) 2024-09-18T00:32:41.959 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:41.959 INFO:teuthology.orchestra.run.smithi081.stdout:4554 write 0x124d20b thru 0x1252627 (0x541d bytes) 2024-09-18T00:32:41.961 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:41.961 INFO:teuthology.orchestra.run.smithi081.stdout:4557 read 0xd6be243 thru 0xd6c58fe (0x76bc bytes) 2024-09-18T00:32:41.968 INFO:teuthology.orchestra.run.smithi081.stdout:4558 trunc from 0xe610545 to 0xb1bf263 2024-09-18T00:32:41.975 INFO:teuthology.orchestra.run.smithi081.stdout:4560 read 0x62b618b thru 0x62bac87 (0x4afd bytes) 2024-09-18T00:32:41.975 INFO:teuthology.orchestra.run.smithi081.stdout:4561 read 0x1e8a86c thru 0x1e8bc11 (0x13a6 bytes) 2024-09-18T00:32:41.976 INFO:teuthology.orchestra.run.smithi081.stdout:4562 read 0x2fc6664 thru 0x2fd65e1 (0xff7e bytes) 2024-09-18T00:32:41.989 INFO:teuthology.orchestra.run.smithi081.stdout:4563 trunc from 0xb1bf263 to 0xfe804f 2024-09-18T00:32:41.997 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:41.995+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:42.004 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.004 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.016 INFO:teuthology.orchestra.run.smithi081.stdout:4564 writesame 0x6016918 thru 0x602634e data_size 0x17(0xfa37 bytes) 2024-09-18T00:32:42.017 INFO:teuthology.orchestra.run.smithi081.stdout:4565 clone 36 order 25 su 524288 sc 14 2024-09-18T00:32:42.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:42.098 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:42.097+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:42.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:32:42.169 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.170 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:42.198 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:42.197+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:42.232 INFO:teuthology.orchestra.run.smithi081.stdout:leaving image image_client.0-clone35 intact 2024-09-18T00:32:42.294 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.295 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.299 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:42.297+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:42.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:42.391 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-18T00:32:42.400 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:42.398+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:42.416 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.416 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:42.512 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:42.511+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:42.537 INFO:teuthology.orchestra.run.smithi081.stdout:4566 punch from 0x84d53b to 0x84d595, (0x5a bytes) 2024-09-18T00:32:42.541 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:42.546 INFO:teuthology.orchestra.run.smithi081.stdout:4568 trunc from 0x602634f to 0x1b3809d 2024-09-18T00:32:42.581 INFO:teuthology.orchestra.run.smithi081.stdout:4569 write 0x16c0450 thru 0x16c2b8a (0x273b bytes) 2024-09-18T00:32:42.582 INFO:teuthology.orchestra.run.smithi081.stdout:4571 punch from 0xa2359a to 0xa2d85d, (0xa2c3 bytes) 2024-09-18T00:32:42.592 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.592 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.593 INFO:teuthology.orchestra.run.smithi081.stdout:4573 trunc from 0x1b3809d to 0x92e1ef8 2024-09-18T00:32:42.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:42.601 INFO:teuthology.orchestra.run.smithi081.stdout:4575 trunc from 0x92e1ef8 to 0x624d249 2024-09-18T00:32:42.614 INFO:teuthology.orchestra.run.smithi081.stdout:4576 write 0x5383795 thru 0x53890f4 (0x5960 bytes) 2024-09-18T00:32:42.615 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:42.613+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:42.617 INFO:teuthology.orchestra.run.smithi081.stdout:4577 read 0x1f0bd86 thru 0x1f1675f (0xa9da bytes) 2024-09-18T00:32:42.617 INFO:teuthology.orchestra.run.smithi081.stdout:4578 read 0x317310f thru 0x3180a8e (0xd980 bytes) 2024-09-18T00:32:42.617 INFO:teuthology.orchestra.run.smithi081.stdout:4579 read 0x2d06b52 thru 0x2d08a35 (0x1ee4 bytes) 2024-09-18T00:32:42.617 INFO:teuthology.orchestra.run.smithi081.stdout:4581 trunc from 0x624d249 to 0x66a37fb 2024-09-18T00:32:42.624 INFO:teuthology.orchestra.run.smithi081.stdout:4583 trunc from 0x66a37fb to 0x80edce6 2024-09-18T00:32:42.639 INFO:teuthology.orchestra.run.smithi081.stdout:4584 write 0xafde541 thru 0xafde987 (0x447 bytes) 2024-09-18T00:32:42.651 INFO:teuthology.orchestra.run.smithi081.stdout:4585 write 0xea1f349 thru 0xea2bd40 (0xc9f8 bytes) 2024-09-18T00:32:42.652 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:42.653 INFO:teuthology.orchestra.run.smithi081.stdout:4588 punch from 0xe1c97a4 to 0xe1cae12, (0x166e bytes) 2024-09-18T00:32:42.653 INFO:teuthology.orchestra.run.smithi081.stdout:4589 write 0xe2c2274 thru 0xe2d0cbf (0xea4c bytes) 2024-09-18T00:32:42.655 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:42.655 INFO:teuthology.orchestra.run.smithi081.stdout:4593 write 0xe68ef57 thru 0xe6919e3 (0x2a8d bytes) 2024-09-18T00:32:42.670 INFO:teuthology.orchestra.run.smithi081.stdout:4594 trunc from 0xea2bd41 to 0x21cb3b8 2024-09-18T00:32:42.686 INFO:teuthology.orchestra.run.smithi081.stdout:4595 write 0xf7858f thru 0xf83966 (0xb3d8 bytes) 2024-09-18T00:32:42.700 INFO:teuthology.orchestra.run.smithi081.stdout:4596 writesame 0x6b739be thru 0x6b7f83d data_size 0x80(0xbe80 bytes) 2024-09-18T00:32:42.700 INFO:teuthology.orchestra.run.smithi081.stdout:4598 punch from 0x2998b6a to 0x29a4ad3, (0xbf69 bytes) 2024-09-18T00:32:42.700 INFO:teuthology.orchestra.run.smithi081.stdout:4600 write 0x51f8173 thru 0x52064f1 (0xe37f bytes) 2024-09-18T00:32:42.703 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:42.702+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:42.703 INFO:teuthology.orchestra.run.smithi081.stdout:4602 read 0x577efc7 thru 0x578c5a8 (0xd5e2 bytes) 2024-09-18T00:32:42.703 INFO:teuthology.orchestra.run.smithi081.stdout:4604 punch from 0x6126a0 to 0x61a5f7, (0x7f57 bytes) 2024-09-18T00:32:42.704 INFO:teuthology.orchestra.run.smithi081.stdout:4605 write 0x2865b20 thru 0x286e3a1 (0x8882 bytes) 2024-09-18T00:32:42.712 INFO:teuthology.orchestra.run.smithi081.stdout:4606 trunc from 0x6b7f83e to 0x47efa4 2024-09-18T00:32:42.731 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:42.731 INFO:teuthology.orchestra.run.smithi081.stdout:4609 read 0x3415e7 thru 0x34cff4 (0xba0e bytes) 2024-09-18T00:32:42.734 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.734 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.741 INFO:teuthology.orchestra.run.smithi081.stdout:4610 trunc from 0x47efa4 to 0x818aa79 2024-09-18T00:32:42.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:42.750 INFO:teuthology.orchestra.run.smithi081.stdout:4611 trunc from 0x818aa79 to 0xb4b842d 2024-09-18T00:32:42.755 INFO:teuthology.orchestra.run.smithi081.stdout:4613 read 0x2905d76 thru 0x290ce59 (0x70e4 bytes) 2024-09-18T00:32:42.755 INFO:teuthology.orchestra.run.smithi081.stdout:4614 write 0x7c2ebf5 thru 0x7c3238b (0x3797 bytes) 2024-09-18T00:32:42.758 INFO:teuthology.orchestra.run.smithi081.stdout:4615 write 0x46d6978 thru 0x46dd965 (0x6fee bytes) 2024-09-18T00:32:42.760 INFO:teuthology.orchestra.run.smithi081.stdout:4616 write 0x98cc3dc thru 0x98d23a8 (0x5fcd bytes) 2024-09-18T00:32:42.771 INFO:teuthology.orchestra.run.smithi081.stdout:4617 write 0xd7c7421 thru 0xd7d03f3 (0x8fd3 bytes) 2024-09-18T00:32:42.772 INFO:teuthology.orchestra.run.smithi081.stdout:4618 punch from 0x2b6260e to 0x2b646a1, (0x2093 bytes) 2024-09-18T00:32:42.773 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:42.773 INFO:teuthology.orchestra.run.smithi081.stdout:4620 punch from 0xa26a559 to 0xa26b227, (0xcce bytes) 2024-09-18T00:32:42.773 INFO:teuthology.orchestra.run.smithi081.stdout:4621 punch from 0x7d4529f to 0x7d5024a, (0xafab bytes) 2024-09-18T00:32:42.773 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:42.773 INFO:teuthology.orchestra.run.smithi081.stdout:4623 read 0x90cd9ba thru 0x90cfc07 (0x224e bytes) 2024-09-18T00:32:42.781 INFO:teuthology.orchestra.run.smithi081.stdout:4624 trunc from 0xd7d03f4 to 0x61e0aba 2024-09-18T00:32:42.789 INFO:teuthology.orchestra.run.smithi081.stdout:4625 writesame 0xf62440 thru 0xf678fa data_size 0x1(0x54bb bytes) 2024-09-18T00:32:42.800 INFO:teuthology.orchestra.run.smithi081.stdout:4627 read 0x510d83 thru 0x5163e8 (0x5666 bytes) 2024-09-18T00:32:42.801 INFO:teuthology.orchestra.run.smithi081.stdout:4628 writesame 0xd263ce thru 0xd2af31 data_size 0x32(0x4b64 bytes) 2024-09-18T00:32:42.804 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:42.802+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:42.818 INFO:teuthology.orchestra.run.smithi081.stdout:4629 write 0xc304b6c thru 0xc307ea3 (0x3338 bytes) 2024-09-18T00:32:42.819 INFO:teuthology.orchestra.run.smithi081.stdout:4630 read 0x2285e56 thru 0x2292e48 (0xcff3 bytes) 2024-09-18T00:32:42.820 INFO:teuthology.orchestra.run.smithi081.stdout:4631 write 0x77f700 thru 0x78bdd6 (0xc6d7 bytes) 2024-09-18T00:32:42.822 INFO:teuthology.orchestra.run.smithi081.stdout:4632 write 0x668c174 thru 0x668f7d1 (0x365e bytes) 2024-09-18T00:32:42.825 INFO:teuthology.orchestra.run.smithi081.stdout:4633 write 0x4200eac thru 0x42101f6 (0xf34b bytes) 2024-09-18T00:32:42.827 INFO:teuthology.orchestra.run.smithi081.stdout:4634 write 0x64babcc thru 0x64c60cb (0xb500 bytes) 2024-09-18T00:32:42.828 INFO:teuthology.orchestra.run.smithi081.stdout:4637 punch from 0x4bcafdb to 0x4bcc4db, (0x1500 bytes) 2024-09-18T00:32:42.828 INFO:teuthology.orchestra.run.smithi081.stdout:4638 writesame 0x74b7abc thru 0x74be68f data_size 0x4(0x6bd4 bytes) 2024-09-18T00:32:42.836 INFO:teuthology.orchestra.run.smithi081.stdout:4639 trunc from 0xc307ea4 to 0xe9ff30f 2024-09-18T00:32:42.859 INFO:teuthology.orchestra.run.smithi081.stdout:4640 trunc from 0xe9ff30f to 0xa33f0e 2024-09-18T00:32:42.867 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:42.867 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:42.869 INFO:teuthology.orchestra.run.smithi081.stdout:4642 read 0x7dfc1d thru 0x7e07f0 (0xbd4 bytes) 2024-09-18T00:32:42.869 INFO:teuthology.orchestra.run.smithi081.stdout:4643 read 0x1b05f6 thru 0x1b6623 (0x602e bytes) 2024-09-18T00:32:42.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:42.880 INFO:teuthology.orchestra.run.smithi081.stdout:4645 write 0x4b79fcb thru 0x4b8839f (0xe3d5 bytes) 2024-09-18T00:32:42.882 INFO:teuthology.orchestra.run.smithi081.stdout:4647 read 0x1951707 thru 0x1951c63 (0x55d bytes) 2024-09-18T00:32:42.882 INFO:teuthology.orchestra.run.smithi081.stdout:4649 write 0x3df4f49 thru 0x3dfe266 (0x931e bytes) 2024-09-18T00:32:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:4651 write 0xed63ce4 thru 0xed662f5 (0x2612 bytes) 2024-09-18T00:32:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:4653 write 0x15d6005 thru 0x15e489a (0xe896 bytes) 2024-09-18T00:32:42.904 INFO:teuthology.orchestra.run.smithi081.stdout:4655 trunc from 0xed662f6 to 0xe053094 2024-09-18T00:32:42.905 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:42.903+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:42.924 INFO:teuthology.orchestra.run.smithi081.stdout:4656 trunc from 0xe053094 to 0x523b9a1 2024-09-18T00:32:42.938 INFO:teuthology.orchestra.run.smithi081.stdout:4657 writesame 0x24f1ea thru 0x25c883 data_size 0xd(0xd69a bytes) 2024-09-18T00:32:42.951 INFO:teuthology.orchestra.run.smithi081.stdout:4658 write 0x72fdb39 thru 0x73021cc (0x4694 bytes) 2024-09-18T00:32:42.953 INFO:teuthology.orchestra.run.smithi081.stdout:4659 punch from 0x1b0940e to 0x1b18a9a, (0xf68c bytes) 2024-09-18T00:32:42.959 INFO:teuthology.orchestra.run.smithi081.stdout:4660 trunc from 0x73021cd to 0x21498b4 2024-09-18T00:32:42.975 INFO:teuthology.orchestra.run.smithi081.stdout:4661 punch from 0xe654fd to 0xe6e075, (0x8b78 bytes) 2024-09-18T00:32:42.985 INFO:teuthology.orchestra.run.smithi081.stdout:4662 writesame 0x4aac89f thru 0x4ab978a data_size 0x52(0xceec bytes) 2024-09-18T00:32:42.986 INFO:teuthology.orchestra.run.smithi081.stdout:4665 read 0x39593be thru 0x3967f91 (0xebd4 bytes) 2024-09-18T00:32:42.987 INFO:teuthology.orchestra.run.smithi081.stdout:4668 write 0x49b4557 thru 0x49b661f (0x20c9 bytes) 2024-09-18T00:32:42.988 INFO:teuthology.orchestra.run.smithi081.stdout:4672 punch from 0x2faba05 to 0x2fad7fe, (0x1df9 bytes) 2024-09-18T00:32:42.989 INFO:teuthology.orchestra.run.smithi081.stdout:4674 punch from 0x2f6813f to 0x2f76f19, (0xedda bytes) 2024-09-18T00:32:42.994 INFO:teuthology.orchestra.run.smithi081.stdout:4675 trunc from 0x4ab978b to 0x283392 2024-09-18T00:32:43.000 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:43.000 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:43.005 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:43.004+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:43.010 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:43.023 INFO:teuthology.orchestra.run.smithi081.stdout:4677 trunc from 0x283392 to 0x514cf04 2024-09-18T00:32:43.039 INFO:teuthology.orchestra.run.smithi081.stdout:4678 write 0x90a4caf thru 0x90b310d (0xe45f bytes) 2024-09-18T00:32:43.046 INFO:teuthology.orchestra.run.smithi081.stdout:4680 trunc from 0x90b310e to 0x5fc4b40 2024-09-18T00:32:43.053 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:43.053 INFO:teuthology.orchestra.run.smithi081.stdout:4683 writesame 0x10df37b thru 0x10ea4f8 data_size 0x3(0xb17e bytes) 2024-09-18T00:32:43.072 INFO:teuthology.orchestra.run.smithi081.stdout:4684 write 0x8971124 thru 0x897834a (0x7227 bytes) 2024-09-18T00:32:43.088 INFO:teuthology.orchestra.run.smithi081.stdout:4686 write 0xd92754b thru 0xd92b4b9 (0x3f6f bytes) 2024-09-18T00:32:43.094 INFO:teuthology.orchestra.run.smithi081.stdout:4687 trunc from 0xd92b4ba to 0x96d158c 2024-09-18T00:32:43.103 INFO:teuthology.orchestra.run.smithi081.stdout:4688 write 0x9485021 thru 0x948b87f (0x685f bytes) 2024-09-18T00:32:43.106 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:43.105+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:43.111 INFO:teuthology.orchestra.run.smithi081.stdout:4689 writesame 0x999fc7c thru 0x99a66a0 data_size 0x1(0x6a25 bytes) 2024-09-18T00:32:43.111 INFO:teuthology.orchestra.run.smithi081.stdout:4690 read 0x8d88ebd thru 0x8d89b7c (0xcc0 bytes) 2024-09-18T00:32:43.111 INFO:teuthology.orchestra.run.smithi081.stdout:4691 writesame 0x5d3eec5 thru 0x5d49bb9 data_size 0x1(0xacf5 bytes) 2024-09-18T00:32:43.122 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:43.122 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.2 primary-affinity to 0.00704125 (84612) 2024-09-18T00:32:43.123 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:32:43.132 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:4692 write 0x101971f thru 0x10255d5 (0xbeb7 bytes) 2024-09-18T00:32:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:43.150 INFO:teuthology.orchestra.run.smithi081.stdout:4694 write 0xc52e731 thru 0xc539e06 (0xb6d6 bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4695 read 0xc355abf thru 0xc3621a2 (0xc6e4 bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4697 read 0x21e022a thru 0x21e5b85 (0x595c bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4698 punch from 0x7c4cd46 to 0x7c567f6, (0x9ab0 bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4701 punch from 0x4c8c2e5 to 0x4c92c3f, (0x695a bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4703 punch from 0x9d4ad79 to 0x9d4ec91, (0x3f18 bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4706 read 0x7f83e47 thru 0x7f88337 (0x44f1 bytes) 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:4708 write 0x67920c2 thru 0x679c24d (0xa18c bytes) 2024-09-18T00:32:43.156 INFO:teuthology.orchestra.run.smithi081.stdout:4709 read 0x8982978 thru 0x8982f27 (0x5b0 bytes) 2024-09-18T00:32:43.161 INFO:teuthology.orchestra.run.smithi081.stdout:4710 trunc from 0xc539e07 to 0xe47105b 2024-09-18T00:32:43.166 INFO:teuthology.orchestra.run.smithi081.stdout:4711 read 0xcb430ab thru 0xcb4c3c5 (0x931b bytes) 2024-09-18T00:32:43.174 INFO:teuthology.orchestra.run.smithi081.stdout:4712 write 0xe6b0dbd thru 0xe6bbedb (0xb11f bytes) 2024-09-18T00:32:43.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:43.187 INFO:teuthology.orchestra.run.smithi081.stdout:4718 write 0xeaa4e9d thru 0xeab4548 (0xf6ac bytes) 2024-09-18T00:32:43.190 INFO:teuthology.orchestra.run.smithi081.stdout:4722 punch from 0x2893798 to 0x28966b5, (0x2f1d bytes) 2024-09-18T00:32:43.190 INFO:teuthology.orchestra.run.smithi081.stdout:4723 punch from 0x4637fe to 0x472dec, (0xf5ee bytes) 2024-09-18T00:32:43.190 INFO:teuthology.orchestra.run.smithi081.stdout:4724 clone 37 order 22 su 2097152 sc 7 2024-09-18T00:32:43.208 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:43.206+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:43.238 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:43.238 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:43.246 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:43.305 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:43.309 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:43.307+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:43.338 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:43.353 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:43.370 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:43.370 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:43.387 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:43.394 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247825148, 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.395 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.399 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247804684999998, 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.403 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247785289999999, 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.404 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247766134999999, 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.408 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:43.412 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247746705000001, 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:43.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247727050000002, 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:43.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:43.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247708056, 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.421 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:43.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.425 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247669130999999, 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:43.429 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247649051, 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.430 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:43.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:43.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247629307, 2024-09-18T00:32:43.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247609528000002, 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.439 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247589940000001, 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:43.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:43.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:43.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:43.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247560474, 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.448 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:43.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.452 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247530140999999, 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:43.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.456 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247503411, 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.457 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:43.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:43.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247476014, 2024-09-18T00:32:43.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:43.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.465 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247450370999999, 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.466 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:43.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:43.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:43.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247425464999999, 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.470 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:43.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247391294, 2024-09-18T00:32:43.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:43.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.478 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 31.247353373999999, 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.482 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.483 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.483 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.483 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:43.483 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:43.484 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:43.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:43.486 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:43.482+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:43.585 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:43.584+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:43.588 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:43.588 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:43.589 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:43.589 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:43.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:43.686 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:43.685+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:43.740 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:43.740 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:43.749 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:43.787 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:43.785+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:43.853 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:43.853 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:43.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:43.853 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:43.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.853 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.049620441000002, 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:43.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.858 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.047689998000003, 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:43.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.047671657999999, 2024-09-18T00:32:43.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.046080936999999, 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.046037704, 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.873 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:43.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:43.877 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.045839557000001, 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:43.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.881 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.045685165000002, 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:43.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.884 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.045471419999998, 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.886 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:43.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.890 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.045273025, 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:43.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.892 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.044912177, 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.898 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:43.899 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.041631178999999, 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:43.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.901 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.903 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.041612004000001, 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:43.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.039752900000003, 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.908 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:43.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.910 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.912 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.039728003, 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:43.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.914 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:43.916 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.039707497999999, 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.917 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.919 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.039688744000003, 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.921 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.925 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.037668463000003, 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.926 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:43.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:43.930 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.037649877, 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:43.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:43.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:43.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.036813963999997, 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.935 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:43.937 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.938 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.031638798000003, 2024-09-18T00:32:43.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:43.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:43.943 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.944 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.944 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.944 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:43.944 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:43.944 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:43.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:43.946 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:43.944+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:44.046 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:44.045+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:44.049 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:44.049 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:44.049 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:44.049 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:44.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:44.147 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:44.146+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:44.165 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:44.165 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:44.165 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:44.165 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:44.165 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:44.174 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:44.241 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone36 from 0xeab4549 (overlap 0x283392) to 0x0 2024-09-18T00:32:44.247 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:44.246+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.327 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.966920049999999, 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:44.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:44.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:44.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.961571513000003, 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:44.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:44.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.336 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.957831788, 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:44.340 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.957807420000002, 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.341 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:44.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:44.345 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.957794839999998, 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:44.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.349 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.957784564000001, 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.350 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.94593038, 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.354 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:44.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.945910009999999, 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:44.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.943950373, 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.943941103999997, 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.941927802999999, 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.941909641999999, 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.939611759000002, 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.939571309000002, 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.939475813000001, 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.937900087999999, 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:44.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:44.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.937879369999997, 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.398 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:44.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:44.402 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.937855837000001, 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:44.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:44.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.937833239, 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:44.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 51.935877681999997, 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:44.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:44.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:44.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.417 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.417 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:44.417 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-18T00:32:44.418 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:44.419 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:44.416+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:44.511 INFO:teuthology.orchestra.run.smithi081.stdout:4726 punch from 0x9d0edf1 to 0x9d17c90, (0x8e9f bytes) 2024-09-18T00:32:44.516 INFO:teuthology.orchestra.run.smithi081.stdout:4727 punch from 0xcaf9d38 to 0xcb05f91, (0xc259 bytes) 2024-09-18T00:32:44.517 INFO:teuthology.orchestra.run.smithi081.stdout:4729 read 0x304577d thru 0x3053350 (0xdbd4 bytes) 2024-09-18T00:32:44.517 INFO:teuthology.orchestra.run.smithi081.stdout:4730 read 0xd19acc4 thru 0xd1a1e69 (0x71a6 bytes) 2024-09-18T00:32:44.517 INFO:teuthology.orchestra.run.smithi081.stdout:4731 write 0xbb3abbe thru 0xbb43670 (0x8ab3 bytes) 2024-09-18T00:32:44.518 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:44.516+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:44.521 INFO:teuthology.orchestra.run.smithi081.stdout:4734 punch from 0x5ff311e to 0x5ff72c5, (0x41a7 bytes) 2024-09-18T00:32:44.521 INFO:teuthology.orchestra.run.smithi081.stdout:4736 read 0x7bb780d thru 0x7bbb490 (0x3c84 bytes) 2024-09-18T00:32:44.521 INFO:teuthology.orchestra.run.smithi081.stdout:4737 punch from 0x2df5496 to 0x2dfa0d5, (0x4c3f bytes) 2024-09-18T00:32:44.521 INFO:teuthology.orchestra.run.smithi081.stdout:4738 write 0xffc8ec thru 0x10052eb (0x8a00 bytes) 2024-09-18T00:32:44.524 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:44.524 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:44.524 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:44.524 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:44.533 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:44.535 INFO:teuthology.orchestra.run.smithi081.stdout:4739 read 0x9ae834c thru 0x9aeb34e (0x3003 bytes) 2024-09-18T00:32:44.535 INFO:teuthology.orchestra.run.smithi081.stdout:4740 read 0xad6a124 thru 0xad77fa7 (0xde84 bytes) 2024-09-18T00:32:44.536 INFO:teuthology.orchestra.run.smithi081.stdout:4741 write 0x7b22719 thru 0x7b2918a (0x6a72 bytes) 2024-09-18T00:32:44.540 INFO:teuthology.orchestra.run.smithi081.stdout:4743 read 0x6f4dd6e thru 0x6f52d85 (0x5018 bytes) 2024-09-18T00:32:44.548 INFO:teuthology.orchestra.run.smithi081.stdout:4745 trunc from 0xeab4549 to 0x8653c97 2024-09-18T00:32:44.565 INFO:teuthology.orchestra.run.smithi081.stdout:4746 read 0x5c6a71 thru 0x5cae26 (0x43b6 bytes) 2024-09-18T00:32:44.565 INFO:teuthology.orchestra.run.smithi081.stdout:4749 read 0x53efd01 thru 0x53fbf24 (0xc224 bytes) 2024-09-18T00:32:44.565 INFO:teuthology.orchestra.run.smithi081.stdout:4750 punch from 0x8450f68 to 0x845f5cd, (0xe665 bytes) 2024-09-18T00:32:44.566 INFO:teuthology.orchestra.run.smithi081.stdout:4752 read 0x5d2282d thru 0x5d2b2d4 (0x8aa8 bytes) 2024-09-18T00:32:44.576 INFO:teuthology.orchestra.run.smithi081.stdout:4753 write 0xb1f9657 thru 0xb1f9938 (0x2e2 bytes) 2024-09-18T00:32:44.580 INFO:teuthology.orchestra.run.smithi081.stdout:4754 write 0x9c0ecfe thru 0x9c107e9 (0x1aec bytes) 2024-09-18T00:32:44.583 INFO:teuthology.orchestra.run.smithi081.stdout:4755 read 0x9da5d1d thru 0x9dac900 (0x6be4 bytes) 2024-09-18T00:32:44.583 INFO:teuthology.orchestra.run.smithi081.stdout:4757 punch from 0x8042085 to 0x804389e, (0x1819 bytes) 2024-09-18T00:32:44.583 INFO:teuthology.orchestra.run.smithi081.stdout:4758 write 0x8ccd40f thru 0x8cd843e (0xb030 bytes) 2024-09-18T00:32:44.588 INFO:teuthology.orchestra.run.smithi081.stdout:4759 trunc from 0xb1f9939 to 0xb810a3f 2024-09-18T00:32:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:44.595 INFO:teuthology.orchestra.run.smithi081.stdout:4761 writesame 0xb303c40 thru 0xb311c7c data_size 0x81(0xe03d bytes) 2024-09-18T00:32:44.599 INFO:teuthology.orchestra.run.smithi081.stdout:4763 write 0x48e8325 thru 0x48f213c (0x9e18 bytes) 2024-09-18T00:32:44.611 INFO:teuthology.orchestra.run.smithi081.stdout:4764 write 0xdd60a45 thru 0xdd6574b (0x4d07 bytes) 2024-09-18T00:32:44.614 INFO:teuthology.orchestra.run.smithi081.stdout:4765 read 0xc0491b5 thru 0xc05481f (0xb66b bytes) 2024-09-18T00:32:44.615 INFO:teuthology.orchestra.run.smithi081.stdout:4768 write 0xbeab2d4 thru 0xbead57e (0x22ab bytes) 2024-09-18T00:32:44.617 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:44.617 INFO:teuthology.orchestra.run.smithi081.stdout:4771 write 0x115210d thru 0x115d5c0 (0xb4b4 bytes) 2024-09-18T00:32:44.619 INFO:teuthology.orchestra.run.smithi081.stdout:4773 writesame 0x71914a8 thru 0x719289d data_size 0x23(0x13f6 bytes) 2024-09-18T00:32:44.619 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:44.617+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:44.623 INFO:teuthology.orchestra.run.smithi081.stdout:4774 read 0x7c45e33 thru 0x7c54115 (0xe2e3 bytes) 2024-09-18T00:32:44.635 INFO:teuthology.orchestra.run.smithi081.stdout:4775 trunc from 0xdd6574c to 0x477c3c0 2024-09-18T00:32:44.655 INFO:teuthology.orchestra.run.smithi081.stdout:4776 read 0x35c1a75 thru 0x35c630c (0x4898 bytes) 2024-09-18T00:32:44.661 INFO:teuthology.orchestra.run.smithi081.stdout:4777 write 0x4b54ee6 thru 0x4b5e07a (0x9195 bytes) 2024-09-18T00:32:44.669 INFO:teuthology.orchestra.run.smithi081.stdout:4780 trunc from 0x4b5e07b to 0xa11d7c2 2024-09-18T00:32:44.675 INFO:teuthology.orchestra.run.smithi081.stdout:4782 read 0x1137249 thru 0x1140faf (0x9d67 bytes) 2024-09-18T00:32:44.676 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:44.676 INFO:teuthology.orchestra.run.smithi081.stdout:4784 read 0x3510cfd thru 0x351437c (0x3680 bytes) 2024-09-18T00:32:44.681 INFO:teuthology.orchestra.run.smithi081.stdout:4785 trunc from 0xa11d7c2 to 0xeba31c7 2024-09-18T00:32:44.685 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:44.685 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:44.685 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:44.685 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:44.685 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:44.687 INFO:teuthology.orchestra.run.smithi081.stdout:4786 punch from 0x5703c9c to 0x570ed21, (0xb085 bytes) 2024-09-18T00:32:44.687 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:44.688 INFO:teuthology.orchestra.run.smithi081.stdout:4788 read 0xb838fca thru 0xb848858 (0xf88f bytes) 2024-09-18T00:32:44.688 INFO:teuthology.orchestra.run.smithi081.stdout:4790 read 0x8c388eb thru 0x8c44b85 (0xc29b bytes) 2024-09-18T00:32:44.694 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:44.702 INFO:teuthology.orchestra.run.smithi081.stdout:4793 trunc from 0xeba31c7 to 0x1f59c2d 2024-09-18T00:32:44.720 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:44.719+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:44.723 INFO:teuthology.orchestra.run.smithi081.stdout:4795 read 0xbc7640 thru 0xbc7bb5 (0x576 bytes) 2024-09-18T00:32:44.734 INFO:teuthology.orchestra.run.smithi081.stdout:4796 trunc from 0x1f59c2d to 0xa553144 2024-09-18T00:32:44.739 INFO:teuthology.orchestra.run.smithi081.stdout:4798 clone 38 order 24 su 65536 sc 9 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1631 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 675840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:44.802 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.446687550999997, 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047626628999999997, 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1631 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353196+0000", 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353197+0000", 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353198+0000", 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2449999999999999e-06 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353201+0000", 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.399e-06 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353205+0000", 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5760000000000002e-06 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400685+0000", 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047480517999999999 2024-09-18T00:32:44.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400769+0000", 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3473000000000005e-05 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400823+0000", 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4137e-05 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.806 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1632 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.446675487, 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047756706000000003, 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1632 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353208+0000", 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353209+0000", 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8099999999999999e-07 2024-09-18T00:32:44.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353210+0000", 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.514e-06 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353216+0000", 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3920000000000002e-06 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.809 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353219+0000", 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.315e-06 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400849+0000", 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047630231000000002 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400901+0000", 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1428999999999998e-05 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.810 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400965+0000", 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4543999999999997e-05 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1633 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.446660965, 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868945000000003, 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.811 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1633 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.353223+0000", 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354886+0000", 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001662979 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354890+0000", 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2599999999999999e-06 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354899+0000", 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3510000000000008e-06 2024-09-18T00:32:44.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.354906+0000", 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5869999999999998e-06 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.400994+0000", 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046087545000000001 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401038+0000", 2024-09-18T00:32:44.814 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4535e-05 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.401092+0000", 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3687999999999998e-05 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1682 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 47104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.444775767000003, 2024-09-18T00:32:44.815 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047536968999999998, 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1682 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355108+0000", 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0100000000000001e-07 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355109+0000", 2024-09-18T00:32:44.817 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8899999999999998e-07 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355112+0000", 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8770000000000002e-06 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355115+0000", 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4030000000000001e-06 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402556+0000", 2024-09-18T00:32:44.818 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047441715000000002 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402596+0000", 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9635000000000003e-05 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402645+0000", 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9149e-05 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1683 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.444766307999998, 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047646796999999998, 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1683 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.820 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.355118+0000", 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356882+0000", 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001764334 2024-09-18T00:32:44.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356890+0000", 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4759999999999998e-06 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356901+0000", 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0533999999999999e-05 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.356912+0000", 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1239e-05 2024-09-18T00:32:44.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402670+0000", 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045757985000000001 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402713+0000", 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3121000000000003e-05 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.402764+0000", 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1107999999999999e-05 2024-09-18T00:32:44.823 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1705 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 706560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.440824622999997, 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047596718000000003, 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.824 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1705 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.359059+0000", 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360881+0000", 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001821802 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360885+0000", 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4809999999999998e-06 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360892+0000", 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3379999999999999e-06 2024-09-18T00:32:44.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.360896+0000", 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6140000000000002e-06 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406437+0000", 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045540046000000001 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406544+0000", 2024-09-18T00:32:44.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107112 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.406656+0000", 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011232500000000001 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1715 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 993280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.438826581000001, 2024-09-18T00:32:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047689281, 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1715 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361057+0000", 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361058+0000", 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.22e-07 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361059+0000", 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.697e-06 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361065+0000", 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.507e-06 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361069+0000", 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.442e-06 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408546+0000", 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047476566999999997 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408638+0000", 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2218000000000004e-05 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408747+0000", 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108528 2024-09-18T00:32:44.832 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1716 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 1021952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.438808960000003, 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047884890999999999, 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.833 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1716 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361075+0000", 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361077+0000", 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.823e-06 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361085+0000", 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5889999999999997e-06 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361089+0000", 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.651e-06 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408783+0000", 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047693194000000001 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408861+0000", 2024-09-18T00:32:44.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8220000000000007e-05 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408960+0000", 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9049999999999995e-05 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1754 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 20480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.438788971000001, 2024-09-18T00:32:44.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048097325000000003, 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1754 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361095+0000", 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7500000000000001e-07 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361097+0000", 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.714e-06 2024-09-18T00:32:44.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361104+0000", 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8580000000000002e-06 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361117+0000", 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3118e-05 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.408998+0000", 2024-09-18T00:32:44.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047881263 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409088+0000", 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9918000000000002e-05 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409192+0000", 2024-09-18T00:32:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104079 2024-09-18T00:32:44.844 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.844 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1755 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.438760152, 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048258826999999997, 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.845 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1755 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361124+0000", 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.32e-07 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361126+0000", 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1059999999999998e-06 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361132+0000", 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0299999999999999e-06 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361137+0000", 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3830000000000002e-06 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409215+0000", 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048078567000000003 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409294+0000", 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8467999999999995e-05 2024-09-18T00:32:44.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409383+0000", 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8840999999999999e-05 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1756 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 77824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.438741491999998, 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048360829000000001, 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.849 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1756 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.850 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361142+0000", 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361143+0000", 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361154+0000", 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1336e-05 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361161+0000", 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2629999999999997e-06 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361171+0000", 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3049999999999998e-06 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409408+0000", 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048237447000000003 2024-09-18T00:32:44.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409451+0000", 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3284000000000001e-05 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409503+0000", 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1833000000000003e-05 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1757 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.438706062000001, 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048438623, 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1757 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.361178+0000", 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362883+0000", 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017047620000000001 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362887+0000", 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1690000000000002e-06 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362897+0000", 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0362e-05 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.362905+0000", 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6369999999999999e-06 2024-09-18T00:32:44.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409527+0000", 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046622334000000001 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409566+0000", 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9427e-05 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409616+0000", 2024-09-18T00:32:44.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9932000000000002e-05 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1764 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 307200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.436805344, 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047564585999999999, 2024-09-18T00:32:44.858 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1764 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363079+0000", 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363081+0000", 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.869e-06 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363087+0000", 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.387e-06 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363092+0000", 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410478+0000", 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047385746999999999 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410535+0000", 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7154999999999997e-05 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410643+0000", 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000108311 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.862 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1765 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.436785415000003, 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047660415999999997, 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1765 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.863 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363098+0000", 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363099+0000", 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6199999999999999e-07 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363102+0000", 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.898e-06 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363108+0000", 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363118+0000", 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9969999999999993e-06 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410660+0000", 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047542415999999997 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410703+0000", 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2231000000000003e-05 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410759+0000", 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6271999999999999e-05 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.866 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1766 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 364544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.436760692999997, 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047868621, 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.867 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1766 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363123+0000", 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.868 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363124+0000", 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6100000000000002e-07 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363125+0000", 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.48e-06 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363129+0000", 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7579999999999998e-06 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363131+0000", 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5320000000000001e-06 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410797+0000", 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047665893000000001 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410892+0000", 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4406000000000004e-05 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.410992+0000", 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100191 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1767 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 393216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.436749364000001, 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047993455999999997, 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.871 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1767 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363134+0000", 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363135+0000", 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0599999999999999e-07 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363139+0000", 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5249999999999999e-06 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363143+0000", 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3550000000000001e-06 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363145+0000", 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6259999999999999e-06 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411022+0000", 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047877292000000002 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411073+0000", 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0528999999999997e-05 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411128+0000", 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4923000000000003e-05 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1768 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.875 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.436735378000002, 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048176798, 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1768 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:44.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363148+0000", 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364882+0000", 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733917 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364892+0000", 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.577e-06 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364911+0000", 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8868999999999998e-05 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364917+0000", 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8640000000000001e-06 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411156+0000", 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046238915999999998 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411220+0000", 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4751000000000004e-05 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.411325+0000", 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104904 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1775 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 622592~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.434841755999997, 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047673465999999998, 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1775 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.880 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365042+0000", 2024-09-18T00:32:44.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1100000000000002e-07 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365044+0000", 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1200000000000001e-06 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365047+0000", 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.269e-06 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365049+0000", 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5720000000000001e-06 2024-09-18T00:32:44.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412581+0000", 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047531363 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412636+0000", 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4969999999999997e-05 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412716+0000", 2024-09-18T00:32:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9861e-05 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1776 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.434831375000002, 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047805461, 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.884 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1776 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365052+0000", 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365053+0000", 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2700000000000001e-07 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365054+0000", 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0189999999999999e-06 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365057+0000", 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0299999999999998e-06 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365059+0000", 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4619999999999999e-06 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412745+0000", 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047685412000000003 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412795+0000", 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9904000000000002e-05 2024-09-18T00:32:44.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412858+0000", 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3406999999999998e-05 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1777 3.e 3:710b1de8:::rbd_data.1197ce767b07.0000000000000007:4 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 52.434821704999997, 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047940417999999999, 2024-09-18T00:32:44.888 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1777 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.365062+0000", 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366880+0000", 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018183279999999999 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366884+0000", 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.002e-06 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366896+0000", 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1119e-05 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.366905+0000", 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4930000000000004e-06 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412893+0000", 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045988345999999999 2024-09-18T00:32:44.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412947+0000", 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413003+0000", 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5770999999999998e-05 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:44.892 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:44.893 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:44.894 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:44.892+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:44.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:44.995 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:44.994+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:44.997 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:44.997 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:45.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:45.096 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:45.095+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:45.109 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:45.109 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:45.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:45.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:32:45.204 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:45.203+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:45.232 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:45.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:45.232 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7084667920000003, 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:32:45.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:32:45.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6967415739999998, 2024-09-18T00:32:45.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:45.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:32:45.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6964482780000001, 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:32:45.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:32:45.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6963061110000002, 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:32:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:32:45.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:32:45.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6960044999999999, 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.255 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:32:45.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.690535004, 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.263 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6905144439999997, 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:45.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:32:45.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:32:45.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6904939519999997, 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:32:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:32:45.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:32:45.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6904745050000001, 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:32:45.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6896511859999999, 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:32:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.68963223, 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:32:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6895985109999998, 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:32:45.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:45.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6895750500000002, 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:45.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:32:45.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6895551300000005, 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:32:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:32:45.299 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6895361319999997, 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:32:45.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.688753567, 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:32:45.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6887229030000004, 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:32:45.308 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:32:45.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:32:45.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6887012429999997, 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.313 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:45.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:32:45.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.688680808, 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:32:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:45.321 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6866501720000002, 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:45.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:45.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:45.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:45.326 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:45.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:45.328 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone37 from 0xa553144 (overlap 0x1f59c2d) to 0x12cf74e 2024-09-18T00:32:45.328 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:45.325+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:45.372 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-18T00:32:45.374 INFO:teuthology.orchestra.run.smithi081.stdout:4799 read 0xa66a6b thru 0xa6ab34 (0x40ca bytes) 2024-09-18T00:32:45.374 INFO:teuthology.orchestra.run.smithi081.stdout:4800 punch from 0x3b8a0f9 to 0x3b957b4, (0xb6bb bytes) 2024-09-18T00:32:45.387 INFO:teuthology.orchestra.run.smithi081.stdout:4802 writesame 0xd857511 thru 0xd861a6b data_size 0x1(0xa55b bytes) 2024-09-18T00:32:45.401 INFO:teuthology.orchestra.run.smithi081.stdout:4803 write 0xed3a601 thru 0xed49edc (0xf8dc bytes) 2024-09-18T00:32:45.405 INFO:teuthology.orchestra.run.smithi081.stdout:4804 read 0x4a42812 thru 0x4a43517 (0xd06 bytes) 2024-09-18T00:32:45.405 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:45.405 INFO:teuthology.orchestra.run.smithi081.stdout:4806 punch from 0xe7097ac to 0xe716831, (0xd085 bytes) 2024-09-18T00:32:45.405 INFO:teuthology.orchestra.run.smithi081.stdout:4807 punch from 0xaa398d1 to 0xaa47e40, (0xe56f bytes) 2024-09-18T00:32:45.421 INFO:teuthology.orchestra.run.smithi081.stdout:4810 trunc from 0xed49edd to 0x937787 2024-09-18T00:32:45.428 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:45.427+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:45.470 INFO:teuthology.orchestra.run.smithi081.stdout:4811 write 0x4f5de5 thru 0x504c9e (0xeeba bytes) 2024-09-18T00:32:45.472 INFO:teuthology.orchestra.run.smithi081.stdout:4812 read 0x47c755 thru 0x48c0f8 (0xf9a4 bytes) 2024-09-18T00:32:45.473 INFO:teuthology.orchestra.run.smithi081.stdout:4813 punch from 0x5974c9 to 0x59f673, (0x81aa bytes) 2024-09-18T00:32:45.485 INFO:teuthology.orchestra.run.smithi081.stdout:4815 write 0x4eca248 thru 0x4ed8558 (0xe311 bytes) 2024-09-18T00:32:45.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:45.495 INFO:teuthology.orchestra.run.smithi081.stdout:4817 write 0x6c0dcab thru 0x6c1c1ac (0xe502 bytes) 2024-09-18T00:32:45.498 INFO:teuthology.orchestra.run.smithi081.stdout:4818 writesame 0x159fd1b thru 0x15acb5e data_size 0x56(0xce44 bytes) 2024-09-18T00:32:45.499 INFO:teuthology.orchestra.run.smithi081.stdout:4819 read 0x3713886 thru 0x371aab4 (0x722f bytes) 2024-09-18T00:32:45.500 INFO:teuthology.orchestra.run.smithi081.stdout:4820 read 0x1c7883e thru 0x1c7924b (0xa0e bytes) 2024-09-18T00:32:45.507 INFO:teuthology.orchestra.run.smithi081.stdout:4821 writesame 0x8a9c9d9 thru 0x8aa4a87 data_size 0x4f(0x80af bytes) 2024-09-18T00:32:45.509 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:45.509 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:45.520 INFO:teuthology.orchestra.run.smithi081.stdout:4822 writesame 0xdb7bfc4 thru 0xdb7f46f data_size 0x2(0x34ac bytes) 2024-09-18T00:32:45.521 INFO:teuthology.orchestra.run.smithi081.stdout:4824 write 0x10110ee thru 0x101ffe1 (0xeef4 bytes) 2024-09-18T00:32:45.523 INFO:teuthology.orchestra.run.smithi081.stdout:4825 clone 39 order 21 su 16384 sc 5 2024-09-18T00:32:45.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:45.569 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:45.564+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:45.615 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:45.615 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:45.630 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:45.628+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:45.632 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:45.652 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:45.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:45.678 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:45.678 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:45.686 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:45.686 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:45.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:45.703 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:45.720 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:45.720 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:45.730 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:45.729+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:45.737 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:45.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:45.831 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:45.830+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:45.918 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:45.918 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:45.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:45.932 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:45.931+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:46.029 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.029 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.034 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:46.032+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:46.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:46.135 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:46.134+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:46.139 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.139 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.144 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:32:46.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:46.236 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:46.235+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:46.261 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.262 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.267 INFO:teuthology.orchestra.run.smithi081.stdout:leaving image image_client.0-clone38 intact 2024-09-18T00:32:46.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:46.337 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:46.336+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:46.379 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.379 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:46.438 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:46.437+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:46.530 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-18T00:32:46.539 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:46.537+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:46.540 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.540 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.549 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:46.557 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:46.557 INFO:teuthology.orchestra.run.smithi081.stdout:4827 write 0x36732e3 thru 0x367d522 (0xa240 bytes) 2024-09-18T00:32:46.595 INFO:teuthology.orchestra.run.smithi081.stdout:4828 punch from 0xc21b176 to 0xc220c4d, (0x5ad7 bytes) 2024-09-18T00:32:46.595 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:46.598 INFO:teuthology.orchestra.run.smithi081.stdout:4833 trunc from 0xdb7f470 to 0xb1467ee 2024-09-18T00:32:46.613 INFO:teuthology.orchestra.run.smithi081.stdout:4834 read 0xa568e2b thru 0xa575049 (0xc21f bytes) 2024-09-18T00:32:46.613 INFO:teuthology.orchestra.run.smithi081.stdout:4835 write 0x6d282e3 thru 0x6d2d83a (0x5558 bytes) 2024-09-18T00:32:46.629 INFO:teuthology.orchestra.run.smithi081.stdout:4836 write 0xda518d thru 0xdb4ecd (0xfd41 bytes) 2024-09-18T00:32:46.640 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:46.637+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:46.669 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.669 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.673 INFO:teuthology.orchestra.run.smithi081.stdout:4840 punch from 0x533f445 to 0x53489df, (0x959a bytes) 2024-09-18T00:32:46.673 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:46.673 INFO:teuthology.orchestra.run.smithi081.stdout:4843 read 0xa0c89b9 thru 0xa0d4076 (0xb6be bytes) 2024-09-18T00:32:46.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:4845 writesame 0xec99759 thru 0xec9aec3 data_size 0xb(0x176b bytes) 2024-09-18T00:32:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:4847 write 0x74984c5 thru 0x7499cde (0x181a bytes) 2024-09-18T00:32:46.693 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:46.693 INFO:teuthology.orchestra.run.smithi081.stdout:4851 read 0xd4fe775 thru 0xd504ee8 (0x6774 bytes) 2024-09-18T00:32:46.693 INFO:teuthology.orchestra.run.smithi081.stdout:4852 writesame 0xc28a888 thru 0xc28f53f data_size 0xa(0x4cb8 bytes) 2024-09-18T00:32:46.700 INFO:teuthology.orchestra.run.smithi081.stdout:4853 write 0xaa454b7 thru 0xaa502f4 (0xae3e bytes) 2024-09-18T00:32:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:4854 writesame 0x545cf66 thru 0x545ebc1 data_size 0x3c(0x1c5c bytes) 2024-09-18T00:32:46.716 INFO:teuthology.orchestra.run.smithi081.stdout:4855 punch from 0x7f18dd7 to 0x7f1cc52, (0x3e7b bytes) 2024-09-18T00:32:46.716 INFO:teuthology.orchestra.run.smithi081.stdout:4856 write 0x2c73888 thru 0x2c8221d (0xe996 bytes) 2024-09-18T00:32:46.741 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:46.739+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:46.753 INFO:teuthology.orchestra.run.smithi081.stdout:4857 writesame 0xaa77a0a thru 0xaa7cfa9 data_size 0x8(0x55a0 bytes) 2024-09-18T00:32:46.761 INFO:teuthology.orchestra.run.smithi081.stdout:4858 trunc from 0xec9aec4 to 0xa1acfc5 2024-09-18T00:32:46.790 INFO:teuthology.orchestra.run.smithi081.stdout:4859 trunc from 0xa1acfc5 to 0xd41d4e1 2024-09-18T00:32:46.796 INFO:teuthology.orchestra.run.smithi081.stdout:4860 write 0x3e37717 thru 0x3e41d93 (0xa67d bytes) 2024-09-18T00:32:46.830 INFO:teuthology.orchestra.run.smithi081.stdout:4862 trunc from 0xd41d4e1 to 0x78b7b35 2024-09-18T00:32:46.833 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:46.834 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:46.842 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:46.839+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:46.844 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout:4863 trunc from 0x78b7b35 to 0xde573f7 2024-09-18T00:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout:4865 writesame 0x8d5db4f thru 0x8d67f6e data_size 0x68(0xa420 bytes) 2024-09-18T00:32:46.897 INFO:teuthology.orchestra.run.smithi081.stdout:4866 writesame 0xab2bb2e thru 0xab2fbd9 data_size 0x1(0x40ac bytes) 2024-09-18T00:32:46.907 INFO:teuthology.orchestra.run.smithi081.stdout:4867 writesame 0x19283a7 thru 0x192a861 data_size 0x1(0x24bb bytes) 2024-09-18T00:32:46.925 INFO:teuthology.orchestra.run.smithi081.stdout:4868 writesame 0x45c5a3e thru 0x45c7f66 data_size 0x7(0x2529 bytes) 2024-09-18T00:32:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:4871 punch from 0x1788d53 to 0x1794e0e, (0xc0bb bytes) 2024-09-18T00:32:46.942 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:46.941+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:46.945 INFO:teuthology.orchestra.run.smithi081.stdout:4872 trunc from 0xde573f7 to 0x525fb05 2024-09-18T00:32:46.991 INFO:teuthology.orchestra.run.smithi081.stdout:4874 read 0x128cf60 thru 0x128e535 (0x15d6 bytes) 2024-09-18T00:32:46.991 INFO:teuthology.orchestra.run.smithi081.stdout:4876 punch from 0xf8ee76 to 0xf90e1c, (0x1fa6 bytes) 2024-09-18T00:32:46.991 INFO:teuthology.orchestra.run.smithi081.stdout:4877 write 0x899d55 thru 0x89bde1 (0x208d bytes) 2024-09-18T00:32:47.003 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.003 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.011 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.012 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:47.022 INFO:teuthology.orchestra.run.smithi081.stdout:4879 write 0x8194e97 thru 0x819c655 (0x77bf bytes) 2024-09-18T00:32:47.030 INFO:teuthology.orchestra.run.smithi081.stdout:4881 trunc from 0x819c656 to 0x536e9ed 2024-09-18T00:32:47.041 INFO:teuthology.orchestra.run.smithi081.stdout:4882 read 0x4b34cfb thru 0x4b437b7 (0xeabd bytes) 2024-09-18T00:32:47.055 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:47.053+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout:4883 write 0xc5066f2 thru 0xc5110d6 (0xa9e5 bytes) 2024-09-18T00:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout:4884 writesame 0x6078d75 thru 0x6087d89 data_size 0x3(0xf015 bytes) 2024-09-18T00:32:47.077 INFO:teuthology.orchestra.run.smithi081.stdout:4886 write 0x744eb0 thru 0x745033 (0x184 bytes) 2024-09-18T00:32:47.079 INFO:teuthology.orchestra.run.smithi081.stdout:4887 read 0xbd45dc thru 0xbd9493 (0x4eb8 bytes) 2024-09-18T00:32:47.079 INFO:teuthology.orchestra.run.smithi081.stdout:4891 writesame 0x7abaefe thru 0x7ac27e5 data_size 0x6a(0x78e8 bytes) 2024-09-18T00:32:47.084 INFO:teuthology.orchestra.run.smithi081.stdout:4893 write 0x5dc1df3 thru 0x5dc8f78 (0x7186 bytes) 2024-09-18T00:32:47.087 INFO:teuthology.orchestra.run.smithi081.stdout:4895 punch from 0x4d4eab to 0x4e2798, (0xd8ed bytes) 2024-09-18T00:32:47.087 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.088 INFO:teuthology.orchestra.run.smithi081.stdout:4899 trunc from 0xc5110d7 to 0xb6dc1d8 2024-09-18T00:32:47.098 INFO:teuthology.orchestra.run.smithi081.stdout:4901 read 0x2a5ed63 thru 0x2a636d3 (0x4971 bytes) 2024-09-18T00:32:47.099 INFO:teuthology.orchestra.run.smithi081.stdout:4902 writesame 0x6940a55 thru 0x69501c6 data_size 0x13(0xf772 bytes) 2024-09-18T00:32:47.106 INFO:teuthology.orchestra.run.smithi081.stdout:4904 read 0x11e09f9 thru 0x11e5f6d (0x5575 bytes) 2024-09-18T00:32:47.106 INFO:teuthology.orchestra.run.smithi081.stdout:4905 punch from 0x91b62bd to 0x91b64d1, (0x214 bytes) 2024-09-18T00:32:47.107 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.107 INFO:teuthology.orchestra.run.smithi081.stdout:4907 write 0x110862e thru 0x110e6c8 (0x609b bytes) 2024-09-18T00:32:47.112 INFO:teuthology.orchestra.run.smithi081.stdout:4908 trunc from 0xb6dc1d8 to 0x851cb71 2024-09-18T00:32:47.118 INFO:teuthology.orchestra.run.smithi081.stdout:4910 trunc from 0x851cb71 to 0x8c7c00f 2024-09-18T00:32:47.124 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.124 INFO:teuthology.orchestra.run.smithi081.stdout:4912 read 0x3377935 thru 0x338509d (0xd769 bytes) 2024-09-18T00:32:47.125 INFO:teuthology.orchestra.run.smithi081.stdout:4913 writesame 0x5caad40 thru 0x5cb6491 data_size 0x82(0xb752 bytes) 2024-09-18T00:32:47.125 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.125 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.128 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.128 INFO:teuthology.orchestra.run.smithi081.stdout:4916 write 0x22f7c96 thru 0x22f9016 (0x1381 bytes) 2024-09-18T00:32:47.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:47.151 INFO:teuthology.orchestra.run.smithi081.stdout:4917 trunc from 0x8c7c00f to 0x16e7f4f 2024-09-18T00:32:47.176 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:47.174+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:47.218 INFO:teuthology.orchestra.run.smithi081.stdout:4918 writesame 0x9186414 thru 0x91897fd data_size 0xf(0x33ea bytes) 2024-09-18T00:32:47.218 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.218 INFO:teuthology.orchestra.run.smithi081.stdout:4920 punch from 0xfe4259 to 0xff13f5, (0xd19c bytes) 2024-09-18T00:32:47.224 INFO:teuthology.orchestra.run.smithi081.stdout:4921 write 0x9ec773a thru 0x9ecf8e9 (0x81b0 bytes) 2024-09-18T00:32:47.232 INFO:teuthology.orchestra.run.smithi081.stdout:4922 write 0x59087af thru 0x590f50a (0x6d5c bytes) 2024-09-18T00:32:47.239 INFO:teuthology.orchestra.run.smithi081.stdout:4923 read 0xb236a3 thru 0xb24711 (0x106f bytes) 2024-09-18T00:32:47.239 INFO:teuthology.orchestra.run.smithi081.stdout:4924 write 0x5072fec thru 0x507ae6c (0x7e81 bytes) 2024-09-18T00:32:47.245 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:47.244+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:47.251 INFO:teuthology.orchestra.run.smithi081.stdout:4925 writesame 0xc3c4328 thru 0xc3d4171 data_size 0x79(0xfe4a bytes) 2024-09-18T00:32:47.251 INFO:teuthology.orchestra.run.smithi081.stdout:4926 read 0xb574685 thru 0xb57574a (0x10c6 bytes) 2024-09-18T00:32:47.251 INFO:teuthology.orchestra.run.smithi081.stdout:4928 read 0xa279868 thru 0xa2892b8 (0xfa51 bytes) 2024-09-18T00:32:47.251 INFO:teuthology.orchestra.run.smithi081.stdout:4931 write 0x5f1708a thru 0x5f1d7e5 (0x675c bytes) 2024-09-18T00:32:47.259 INFO:teuthology.orchestra.run.smithi081.stdout:4932 punch from 0xa53b35b to 0xa548416, (0xd0bb bytes) 2024-09-18T00:32:47.259 INFO:teuthology.orchestra.run.smithi081.stdout:4934 write 0xbc3bdee thru 0xbc41405 (0x5618 bytes) 2024-09-18T00:32:47.269 INFO:teuthology.orchestra.run.smithi081.stdout:4936 read 0x5f104c4 thru 0x5f1843f (0x7f7c bytes) 2024-09-18T00:32:47.269 INFO:teuthology.orchestra.run.smithi081.stdout:4937 writesame 0xa96e4f4 thru 0xa97b812 data_size 0x1(0xd31f bytes) 2024-09-18T00:32:47.284 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.285 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.296 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:47.304 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.304 INFO:teuthology.orchestra.run.smithi081.stdout:4940 trunc from 0xc3d4172 to 0xbb44277 2024-09-18T00:32:47.313 INFO:teuthology.orchestra.run.smithi081.stdout:4941 read 0x795bf75 thru 0x7960035 (0x40c1 bytes) 2024-09-18T00:32:47.313 INFO:teuthology.orchestra.run.smithi081.stdout:4942 write 0x7555263 thru 0x755716e (0x1f0c bytes) 2024-09-18T00:32:47.316 INFO:teuthology.orchestra.run.smithi081.stdout:4943 punch from 0xa0c1739 to 0xa0ce5e9, (0xceb0 bytes) 2024-09-18T00:32:47.316 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.330 INFO:teuthology.orchestra.run.smithi081.stdout:4945 trunc from 0xbb44277 to 0x6ceb4 2024-09-18T00:32:47.346 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:47.345+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:47.388 INFO:teuthology.orchestra.run.smithi081.stdout:4946 read 0x51650 thru 0x56494 (0x4e45 bytes) 2024-09-18T00:32:47.388 INFO:teuthology.orchestra.run.smithi081.stdout:4947 read 0x63d57 thru 0x6ceb3 (0x915d bytes) 2024-09-18T00:32:47.395 INFO:teuthology.orchestra.run.smithi081.stdout:4949 trunc from 0x6ceb4 to 0x55b57cb 2024-09-18T00:32:47.406 INFO:teuthology.orchestra.run.smithi081.stdout:4952 trunc from 0x55b57cb to 0xca3ea0 2024-09-18T00:32:47.411 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.411 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.412 INFO:teuthology.orchestra.run.smithi081.stdout:4953 read 0xaf940f thru 0xb01ae0 (0x86d2 bytes) 2024-09-18T00:32:47.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:47.435 INFO:teuthology.orchestra.run.smithi081.stdout:4954 writesame 0xdbabf29 thru 0xdbac74c data_size 0x2(0x824 bytes) 2024-09-18T00:32:47.435 INFO:teuthology.orchestra.run.smithi081.stdout:4955 punch from 0x2459829 to 0x24619ef, (0x81c6 bytes) 2024-09-18T00:32:47.435 INFO:teuthology.orchestra.run.smithi081.stdout:4956 punch from 0xd4759ad to 0xd47f664, (0x9cb7 bytes) 2024-09-18T00:32:47.436 INFO:teuthology.orchestra.run.smithi081.stdout:4957 read 0x5fe717 thru 0x608276 (0x9b60 bytes) 2024-09-18T00:32:47.436 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.448 INFO:teuthology.orchestra.run.smithi081.stdout:4961 trunc from 0xdbac74d to 0x3693481 2024-09-18T00:32:47.464 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:47.462+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:47.466 INFO:teuthology.orchestra.run.smithi081.stdout:4962 writesame 0x781620f thru 0x7825ad6 data_size 0x4(0xf8c8 bytes) 2024-09-18T00:32:47.466 INFO:teuthology.orchestra.run.smithi081.stdout:4963 punch from 0x55b34af to 0x55b5044, (0x1b95 bytes) 2024-09-18T00:32:47.466 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.466 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.466 INFO:teuthology.orchestra.run.smithi081.stdout:4969 writesame 0x6d488d2 thru 0x6d4ceea data_size 0x25(0x4619 bytes) 2024-09-18T00:32:47.470 INFO:teuthology.orchestra.run.smithi081.stdout:4970 writesame 0x1c5b5d5 thru 0x1c5c605 data_size 0x1(0x1031 bytes) 2024-09-18T00:32:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:4973 read 0x141618f thru 0x1419e9d (0x3d0f bytes) 2024-09-18T00:32:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:4974 read 0x51dbb1d thru 0x51ddc5d (0x2141 bytes) 2024-09-18T00:32:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:4976 read 0x119366 thru 0x11f66a (0x6305 bytes) 2024-09-18T00:32:47.475 INFO:teuthology.orchestra.run.smithi081.stdout:4977 write 0x1b7f7e thru 0x1c04d8 (0x855b bytes) 2024-09-18T00:32:47.480 INFO:teuthology.orchestra.run.smithi081.stdout:4979 write 0x4044b0a thru 0x404ab42 (0x6039 bytes) 2024-09-18T00:32:47.483 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.483 INFO:teuthology.orchestra.run.smithi081.stdout:4981 read 0x289de3d thru 0x28aae6f (0xd033 bytes) 2024-09-18T00:32:47.498 INFO:teuthology.orchestra.run.smithi081.stdout:4982 write 0xdd2489f thru 0xdd249ee (0x150 bytes) 2024-09-18T00:32:47.501 INFO:teuthology.orchestra.run.smithi081.stdout:4984 read 0x85aa63f thru 0x85ae740 (0x4102 bytes) 2024-09-18T00:32:47.501 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.501 INFO:teuthology.orchestra.run.smithi081.stdout:4987 write 0x829e5c7 thru 0x82ab056 (0xca90 bytes) 2024-09-18T00:32:47.506 INFO:teuthology.orchestra.run.smithi081.stdout:4988 punch from 0x4ff7fb7 to 0x4ffd903, (0x594c bytes) 2024-09-18T00:32:47.519 INFO:teuthology.orchestra.run.smithi081.stdout:4989 trunc from 0xdd249ef to 0x33e09c0 2024-09-18T00:32:47.531 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.531 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.541 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:47.548 INFO:teuthology.orchestra.run.smithi081.stdout:4990 write 0xe25ce8b thru 0xe25e24a (0x13c0 bytes) 2024-09-18T00:32:47.551 INFO:teuthology.orchestra.run.smithi081.stdout:4991 write 0xbb8c8ff thru 0xbb98cdb (0xc3dd bytes) 2024-09-18T00:32:47.556 INFO:teuthology.orchestra.run.smithi081.stdout:4993 writesame 0x2a6a981 thru 0x2a7a261 data_size 0x1(0xf8e1 bytes) 2024-09-18T00:32:47.581 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:47.579+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:47.594 INFO:teuthology.orchestra.run.smithi081.stdout:4994 read 0x960aedd thru 0x9616fd6 (0xc0fa bytes) 2024-09-18T00:32:47.610 INFO:teuthology.orchestra.run.smithi081.stdout:4995 trunc from 0xe25e24b to 0x2a3f59 2024-09-18T00:32:47.643 INFO:teuthology.orchestra.run.smithi081.stdout:4996 write 0x8565842 thru 0x856e6de (0x8e9d bytes) 2024-09-18T00:32:47.648 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:47.647+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:47.652 INFO:teuthology.orchestra.run.smithi081.stdout:4997 punch from 0x50b5e34 to 0x50c1484, (0xb650 bytes) 2024-09-18T00:32:47.652 INFO:teuthology.orchestra.run.smithi081.stdout:4998 punch from 0x20b1b17 to 0x20bad45, (0x922e bytes) 2024-09-18T00:32:47.660 INFO:teuthology.orchestra.run.smithi081.stdout:5000 write 0x97e5de2 thru 0x97f5dcd (0xffec bytes) 2024-09-18T00:32:47.668 INFO:teuthology.orchestra.run.smithi081.stdout:5001 punch from 0x38cdd2a to 0x38d8bdb, (0xaeb1 bytes) 2024-09-18T00:32:47.673 INFO:teuthology.orchestra.run.smithi081.stdout:5002 trunc from 0x97f5dce to 0x5dc64f3 2024-09-18T00:32:47.686 INFO:teuthology.orchestra.run.smithi081.stdout:5003 writesame 0x17cfe09 thru 0x17d2b99 data_size 0x1(0x2d91 bytes) 2024-09-18T00:32:47.691 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.691 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.698 INFO:teuthology.orchestra.run.smithi081.stdout:5004 trunc from 0x5dc64f3 to 0x892972f 2024-09-18T00:32:47.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:47.704 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.704 INFO:teuthology.orchestra.run.smithi081.stdout:5007 write 0xa210ac thru 0xa2a88d (0x97e2 bytes) 2024-09-18T00:32:47.712 INFO:teuthology.orchestra.run.smithi081.stdout:5008 write 0x9b0d07 thru 0x9c0081 (0xf37b bytes) 2024-09-18T00:32:47.713 INFO:teuthology.orchestra.run.smithi081.stdout:5010 writesame 0x3c28fa3 thru 0x3c30844 data_size 0x3(0x78a2 bytes) 2024-09-18T00:32:47.724 INFO:teuthology.orchestra.run.smithi081.stdout:5011 write 0x3d16dd9 thru 0x3d23df9 (0xd021 bytes) 2024-09-18T00:32:47.730 INFO:teuthology.orchestra.run.smithi081.stdout:5012 trunc from 0x892972f to 0xa3da111 2024-09-18T00:32:47.736 INFO:teuthology.orchestra.run.smithi081.stdout:5013 read 0x75dda76 thru 0x75ddcb2 (0x23d bytes) 2024-09-18T00:32:47.736 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.737 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.737 INFO:teuthology.orchestra.run.smithi081.stdout:5016 trunc from 0xa3da111 to 0x9ef995e 2024-09-18T00:32:47.748 INFO:teuthology.orchestra.run.smithi081.stdout:5017 trunc from 0x9ef995e to 0xe4e11c2 2024-09-18T00:32:47.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:47.749 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:47.747+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:47.754 INFO:teuthology.orchestra.run.smithi081.stdout:5023 read 0xdf92d26 thru 0xdf97eb5 (0x5190 bytes) 2024-09-18T00:32:47.754 INFO:teuthology.orchestra.run.smithi081.stdout:5025 write 0x57fab67 thru 0x58000d3 (0x556d bytes) 2024-09-18T00:32:47.764 INFO:teuthology.orchestra.run.smithi081.stdout:5026 read 0x49bc74b thru 0x49c71d4 (0xaa8a bytes) 2024-09-18T00:32:47.764 INFO:teuthology.orchestra.run.smithi081.stdout:5027 write 0x56993ba thru 0x56a5a9b (0xc6e2 bytes) 2024-09-18T00:32:47.770 INFO:teuthology.orchestra.run.smithi081.stdout:5029 read 0x3af56fa thru 0x3af6b31 (0x1438 bytes) 2024-09-18T00:32:47.770 INFO:teuthology.orchestra.run.smithi081.stdout:5030 punch from 0x84c37d3 to 0x84d0ff0, (0xd81d bytes) 2024-09-18T00:32:47.770 INFO:teuthology.orchestra.run.smithi081.stdout:5034 write 0x1a23734 thru 0x1a28fa9 (0x5876 bytes) 2024-09-18T00:32:47.774 INFO:teuthology.orchestra.run.smithi081.stdout:5036 writesame 0x3719c1f thru 0x3723f55 data_size 0x2f(0xa337 bytes) 2024-09-18T00:32:47.779 INFO:teuthology.orchestra.run.smithi081.stdout:5037 write 0xd632df9 thru 0xd63c079 (0x9281 bytes) 2024-09-18T00:32:47.789 INFO:teuthology.orchestra.run.smithi081.stdout:5038 trunc from 0xe4e11c2 to 0xb2baca2 2024-09-18T00:32:47.800 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.800 INFO:teuthology.orchestra.run.smithi081.stdout:5040 read 0x38d79c3 thru 0x38d83aa (0x9e8 bytes) 2024-09-18T00:32:47.800 INFO:teuthology.orchestra.run.smithi081.stdout:5042 read 0x83cb4fd thru 0x83cd256 (0x1d5a bytes) 2024-09-18T00:32:47.810 INFO:teuthology.orchestra.run.smithi081.stdout:5044 write 0xe5bb5df thru 0xe5c5a86 (0xa4a8 bytes) 2024-09-18T00:32:47.810 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.810 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.818 INFO:teuthology.orchestra.run.smithi081.stdout:5045 write 0x53c23d6 thru 0x53cc8e8 (0xa513 bytes) 2024-09-18T00:32:47.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:47.822 INFO:teuthology.orchestra.run.smithi081.stdout:5047 write 0x1ed18fa thru 0x1ed6cee (0x53f5 bytes) 2024-09-18T00:32:47.827 INFO:teuthology.orchestra.run.smithi081.stdout:5048 writesame 0xc04aace thru 0xc0528ba data_size 0x1(0x7ded bytes) 2024-09-18T00:32:47.849 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.849 INFO:teuthology.orchestra.run.smithi081.stdout:5051 read 0xd56ed7c thru 0xd57c664 (0xd8e9 bytes) 2024-09-18T00:32:47.849 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.849 INFO:teuthology.orchestra.run.smithi081.stdout:5056 write 0x12b6fe5 thru 0x12c3c62 (0xcc7e bytes) 2024-09-18T00:32:47.857 INFO:teuthology.orchestra.run.smithi081.stdout:5057 trunc from 0xe5c5a87 to 0xb3212fd 2024-09-18T00:32:47.864 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:47.861+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:47.880 INFO:teuthology.orchestra.run.smithi081.stdout:5058 writesame 0xc57d0c7 thru 0xc586a64 data_size 0x35(0x999e bytes) 2024-09-18T00:32:47.880 INFO:teuthology.orchestra.run.smithi081.stdout:5059 read 0x9318421 thru 0x931cc87 (0x4867 bytes) 2024-09-18T00:32:47.881 INFO:teuthology.orchestra.run.smithi081.stdout:5060 write 0x1b07d67 thru 0x1b1545d (0xd6f7 bytes) 2024-09-18T00:32:47.887 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:47.887 INFO:teuthology.orchestra.run.smithi081.stdout:5061 punch from 0xb71b2e4 to 0xb726bf1, (0xb90d bytes) 2024-09-18T00:32:47.887 INFO:teuthology.orchestra.run.smithi081.stdout:5063 read 0x4df745b thru 0x4e010ed (0x9c93 bytes) 2024-09-18T00:32:47.888 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.888 INFO:teuthology.orchestra.run.smithi081.stdout:5065 read 0xc1b26a5 thru 0xc1bdbde (0xb53a bytes) 2024-09-18T00:32:47.890 INFO:teuthology.orchestra.run.smithi081.stdout:5066 trunc from 0xc586a65 to 0xea79bd4 2024-09-18T00:32:47.896 INFO:teuthology.orchestra.run.smithi081.stdout:5067 write 0x25ba236 thru 0x25bcfbd (0x2d88 bytes) 2024-09-18T00:32:47.900 INFO:teuthology.orchestra.run.smithi081.stdout:5068 read 0xe369367 thru 0xe36d01f (0x3cb9 bytes) 2024-09-18T00:32:47.900 INFO:teuthology.orchestra.run.smithi081.stdout:5069 punch from 0xc0b94ae to 0xc0c17b9, (0x830b bytes) 2024-09-18T00:32:47.900 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:47.900 INFO:teuthology.orchestra.run.smithi081.stdout:5072 write 0x97a834c thru 0x97a87ac (0x461 bytes) 2024-09-18T00:32:47.902 INFO:teuthology.orchestra.run.smithi081.stdout:5073 punch from 0xd1c162a to 0xd1ce863, (0xd239 bytes) 2024-09-18T00:32:47.903 INFO:teuthology.orchestra.run.smithi081.stdout:5075 write 0xb36ab34 thru 0xb36cae8 (0x1fb5 bytes) 2024-09-18T00:32:47.906 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:47.907 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:47.909 INFO:teuthology.orchestra.run.smithi081.stdout:5076 read 0x9bb9b5f thru 0x9bbb35e (0x1800 bytes) 2024-09-18T00:32:47.909 INFO:teuthology.orchestra.run.smithi081.stdout:5077 clone 40 order 21 su 16384 sc 9 2024-09-18T00:32:47.929 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:47.929 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:47.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:47.951 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:47.950+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:48.052 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:48.051+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:48.080 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:48.080 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:48.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:48.123 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:48.124 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:48.139 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:48.145 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:48.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:48.146 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-18T00:32:48.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T00:32:48.152 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:48.150+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:48.157 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:48.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:32:48.177 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:48.197 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:48.197 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:48.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:48.209 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:48.231 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:48.254 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:48.252+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:48.297 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone39 from 0xea79bd4 (overlap 0x6ceb4) to 0x0 2024-09-18T00:32:48.333 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:48.333 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:48.333 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:48.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:48.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:48.386 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:48.385+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:48.456 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:48.453+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:48.461 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:48.461 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:48.461 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:48.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 77, 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "1111294f-f881-4427-a507-2f6f0939f89f", 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-18T00:31:16.967705+0000", 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-18T00:32:48.147473+0000", 2024-09-18T00:32:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-18T00:31:29.069471+0000", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-18T00:31:19.984105+0000", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:48.487 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 6, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "squid", 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-18T00:32:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:29.068996+0000", 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:48.489 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:48.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "17", 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:48.491 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:48.492 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 8, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.25, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.87587928771972656, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87999999523162842, 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:35.737341+0000", 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:48.495 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-18T00:32:48.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "21", 2024-09-18T00:32:48.497 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 2, 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 21, 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:48.498 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:48.499 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:48.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:48.501 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:48.502 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.9900000095367432, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.9900000095367432, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.75, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.75, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.87587928771972656, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87999999523162842, 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-18T00:32:48.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:45.237398+0000", 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:32:48.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:32:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:32:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:32:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:32:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:32:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:32:48.505 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-18T00:32:48.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:32:48.507 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "77", 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 42, 2024-09-18T00:32:48.508 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 77, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:32:48.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:32:48.510 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.5, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.5, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.5, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.5, 2024-09-18T00:32:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.87587928771972656, 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87999999523162842, 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "f3f5415f-ac86-4dd6-8c50-5391b44b9c6b", 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.512 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-18T00:32:48.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-18T00:32:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-18T00:32:48.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6803/2689107883", 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/2689107883", 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6809/2689107883", 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6807/2689107883", 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.517 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "06a47ef1-1ae7-40a2-a998-daac122fc229", 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:48.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6813/1726163291", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6817/1726163291", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6825/1726163291", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6821/1726163291", 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.523 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "653ab61a-1037-4190-8806-7042ef3d0586", 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.524 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.0070343017578125, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 18, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-18T00:32:48.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-18T00:32:48.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-18T00:32:48.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6812/365910818", 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6816/365910818", 2024-09-18T00:32:48.529 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6824/365910818", 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6820/365910818", 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f", 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.530 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 73, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-18T00:32:48.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6832", 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6833", 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6827/2780316581", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6829/2780316581", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6833/2780316581", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6831/2780316581", 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.535 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "7000f249-35b4-4770-8452-8f31064ef1de", 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.536 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 32, 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6824", 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6825", 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6826", 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6827", 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6830", 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6831", 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6828", 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6829", 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6825/2008948201", 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6827/2008948201", 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6831/2008948201", 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6829/2008948201", 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "755442b3-b418-409d-bd0a-376579eeb381", 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6816", 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6817", 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6818", 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6819", 2024-09-18T00:32:48.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6822", 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6823", 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6820", 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6821", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6817/2331356901", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6819/2331356901", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6823/2331356901", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6821/2331356901", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6b406b2b-e850-41be-bce8-9f13d2921c60", 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.548 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6800", 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6801", 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6802", 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6803", 2024-09-18T00:32:48.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6806", 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6807", 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6804", 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6805", 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6801/2657673991", 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6803/2657673991", 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6807/2657673991", 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6805/2657673991", 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "8bb8987f-d8e4-494e-82ce-e1203957c35f", 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:32:48.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 38, 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6808", 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6809", 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6810", 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6811", 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6814", 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6815", 2024-09-18T00:32:48.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6812", 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:32:48.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6813", 2024-09-18T00:32:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:32:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6809/2652298701", 2024-09-18T00:32:48.559 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6811/2652298701", 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6815/2652298701", 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6813/2652298701", 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-18T00:32:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:32:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.561 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.022758+0000", 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:27.126737+0000", 2024-09-18T00:32:48.563 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:32:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.564 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.821608+0000", 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.565 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.574908+0000", 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.569036+0000", 2024-09-18T00:32:48.566 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.436338+0000", 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.567 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.050552+0000", 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:32:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.299077+0000", 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-18T00:32:48.569 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-18T00:32:48.570 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-18T00:32:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-18T00:32:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-18T00:32:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-18T00:32:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-18T00:32:48.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.571 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:48.573 INFO:tasks.thrashosds.thrasher:j is {'epoch': 77, 'fsid': '1111294f-f881-4427-a507-2f6f0939f89f', 'created': '2024-09-18T00:31:16.967705+0000', 'modified': '2024-09-18T00:32:48.147473+0000', 'last_up_change': '2024-09-18T00:31:29.069471+0000', 'last_in_change': '2024-09-18T00:31:19.984105+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T00:31:29.068996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8758792877197266, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T00:31:35.737341+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8758792877197266, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T00:31:45.237398+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 42, 'snap_epoch': 77, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8758792877197266, 'average_primary_affinity': 0.8799999952316284, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': 'f3f5415f-ac86-4dd6-8c50-5391b44b9c6b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 2689107883}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 2689107883}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 2689107883}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 2689107883}]}, 'public_addr': '172.21.15.81:6803/2689107883', 'cluster_addr': '172.21.15.81:6805/2689107883', 'heartbeat_back_addr': '172.21.15.81:6809/2689107883', 'heartbeat_front_addr': '172.21.15.81:6807/2689107883', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '06a47ef1-1ae7-40a2-a998-daac122fc229', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6811', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1726163291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6815', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6817', 'nonce': 1726163291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 1726163291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6819', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 1726163291}]}, 'public_addr': '172.21.15.81:6813/1726163291', 'cluster_addr': '172.21.15.81:6817/1726163291', 'heartbeat_back_addr': '172.21.15.81:6825/1726163291', 'heartbeat_front_addr': '172.21.15.81:6821/1726163291', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '653ab61a-1037-4190-8806-7042ef3d0586', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0070343017578125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6812', 'nonce': 365910818}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6816', 'nonce': 365910818}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 365910818}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6818', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6820', 'nonce': 365910818}]}, 'public_addr': '172.21.15.81:6812/365910818', 'cluster_addr': '172.21.15.81:6816/365910818', 'heartbeat_back_addr': '172.21.15.81:6824/365910818', 'heartbeat_front_addr': '172.21.15.81:6820/365910818', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6827', 'nonce': 2780316581}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6828', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 2780316581}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 2780316581}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 2780316581}]}, 'public_addr': '172.21.15.81:6827/2780316581', 'cluster_addr': '172.21.15.81:6829/2780316581', 'heartbeat_back_addr': '172.21.15.81:6833/2780316581', 'heartbeat_front_addr': '172.21.15.81:6831/2780316581', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7000f249-35b4-4770-8452-8f31064ef1de', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6824', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6825', 'nonce': 2008948201}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6826', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6827', 'nonce': 2008948201}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6830', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6831', 'nonce': 2008948201}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6828', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6829', 'nonce': 2008948201}]}, 'public_addr': '172.21.15.167:6825/2008948201', 'cluster_addr': '172.21.15.167:6827/2008948201', 'heartbeat_back_addr': '172.21.15.167:6831/2008948201', 'heartbeat_front_addr': '172.21.15.167:6829/2008948201', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '755442b3-b418-409d-bd0a-376579eeb381', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6816', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6817', 'nonce': 2331356901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6818', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6819', 'nonce': 2331356901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6822', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6823', 'nonce': 2331356901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6820', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6821', 'nonce': 2331356901}]}, 'public_addr': '172.21.15.167:6817/2331356901', 'cluster_addr': '172.21.15.167:6819/2331356901', 'heartbeat_back_addr': '172.21.15.167:6823/2331356901', 'heartbeat_front_addr': '172.21.15.167:6821/2331356901', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6b406b2b-e850-41be-bce8-9f13d2921c60', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6800', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6801', 'nonce': 2657673991}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6802', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6803', 'nonce': 2657673991}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6806', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6807', 'nonce': 2657673991}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6804', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6805', 'nonce': 2657673991}]}, 'public_addr': '172.21.15.167:6801/2657673991', 'cluster_addr': '172.21.15.167:6803/2657673991', 'heartbeat_back_addr': '172.21.15.167:6807/2657673991', 'heartbeat_front_addr': '172.21.15.167:6805/2657673991', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '8bb8987f-d8e4-494e-82ce-e1203957c35f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6808', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6809', 'nonce': 2652298701}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6810', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6811', 'nonce': 2652298701}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6814', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6815', 'nonce': 2652298701}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6812', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6813', 'nonce': 2652298701}]}, 'public_addr': '172.21.15.167:6809/2652298701', 'cluster_addr': '172.21.15.167:6811/2652298701', 'heartbeat_back_addr': '172.21.15.167:6815/2652298701', 'heartbeat_front_addr': '172.21.15.167:6813/2652298701', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.022758+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:27.126737+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.821608+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.574908+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.569036+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.436338+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.050552+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.299077+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T00:32:48.573 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-18T00:32:48.573 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-18T00:32:48.574 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:48.570+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:48.673 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:48.670+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:48.685 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:48.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1619001099999995, 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:32:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:32:48.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1501748920000008, 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:32:48.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1498815960000002, 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:32:48.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:32:48.699 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1497394290000003, 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1494378179999991, 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:32:48.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1439683219999992, 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:32:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:32:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1439477619999998, 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:32:48.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1439272700000007, 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.719 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1439078229999993, 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:32:48.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:32:48.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1430845040000008, 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:32:48.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:32:48.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1430655479999992, 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:32:48.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1430318289999999, 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:32:48.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1430083680000003, 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:32:48.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1429884480000005, 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:32:48.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1429694500000007, 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:32:48.751 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:32:48.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1421868849999992, 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:32:48.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:32:48.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1421562210000005, 2024-09-18T00:32:48.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:48.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:32:48.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1421345610000007, 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1421141259999992, 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:32:48.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1400834900000003, 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:48.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:32:48.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:32:48.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:48.778 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:48.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:48.780 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:48.778+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:48.791 INFO:teuthology.orchestra.run.smithi081.stdout:5078 trunc from 0xea79bd4 to 0x59d9060 2024-09-18T00:32:48.846 INFO:teuthology.orchestra.run.smithi081.stdout:5079 clone 41 order 19 su 2048 sc 5 2024-09-18T00:32:48.881 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:48.879+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:48.905 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:48.906 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:48.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:48.999 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:48.997+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:49.058 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:49.058 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:49.058 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:49.058 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:49.058 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:49.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:49.083 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:49.081+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:32:49.184 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:49.183+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.749234313999999, 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:32:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748943599, 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:32:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:32:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748897139999997, 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:32:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748873644, 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:32:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748851139000003, 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748341189000001, 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748291101, 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748259730999997, 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748237644, 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.748215606000002, 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:32:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.747053584, 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:32:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:32:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:32:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.747022264000002, 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:32:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:32:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.746990468, 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:32:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:32:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:32:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.746965357000001, 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:32:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.746921890000003, 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.746900003, 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.746842725, 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:32:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:32:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.746815636000001, 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:32:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.41618559799999999, 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:32:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.41616657000000001, 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:32:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:32:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:32:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.308 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:49.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:49.310 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:49.307+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:49.311 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone40 from 0x59d9060 (overlap 0x59d9060) to 0x3ee4b76 2024-09-18T00:32:49.410 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:49.409+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:49.433 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:49.433 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:49.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:49.511 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:49.509+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:49.523 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-18T00:32:49.543 INFO:teuthology.orchestra.run.smithi081.stdout:5080 write 0xc0f6680 thru 0xc104fdb (0xe95c bytes) 2024-09-18T00:32:49.551 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:49.551 INFO:teuthology.orchestra.run.smithi081.stdout:5082 read 0xaa2eec0 thru 0xaa3969a (0xa7db bytes) 2024-09-18T00:32:49.551 INFO:teuthology.orchestra.run.smithi081.stdout:5083 read 0x1be6723 thru 0x1be9ead (0x378b bytes) 2024-09-18T00:32:49.552 INFO:teuthology.orchestra.run.smithi081.stdout:5084 read 0xe9712b thru 0xe9ca40 (0x5916 bytes) 2024-09-18T00:32:49.553 INFO:teuthology.orchestra.run.smithi081.stdout:5085 write 0xbd6f3c5 thru 0xbd7ca78 (0xd6b4 bytes) 2024-09-18T00:32:49.564 INFO:teuthology.orchestra.run.smithi081.stdout:5086 write 0x462f50f thru 0x463a4da (0xafcc bytes) 2024-09-18T00:32:49.605 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:49.605 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:49.606 INFO:teuthology.orchestra.run.smithi081.stdout:5087 write 0x7f08684 thru 0x7f10a93 (0x8410 bytes) 2024-09-18T00:32:49.612 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:49.609+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:49.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:49.625 INFO:teuthology.orchestra.run.smithi081.stdout:5088 trunc from 0xc104fdc to 0x1144824 2024-09-18T00:32:49.713 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:49.711+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:49.718 INFO:teuthology.orchestra.run.smithi081.stdout:5089 writesame 0x6f6cb98 thru 0x6f7b30c data_size 0x1(0xe775 bytes) 2024-09-18T00:32:49.718 INFO:teuthology.orchestra.run.smithi081.stdout:5090 writesame 0x39abf9d thru 0x39b0998 data_size 0xa(0x49fc bytes) 2024-09-18T00:32:49.726 INFO:teuthology.orchestra.run.smithi081.stdout:5091 read 0x37219ec thru 0x372526b (0x3880 bytes) 2024-09-18T00:32:49.726 INFO:teuthology.orchestra.run.smithi081.stdout:5092 writesame 0x25069de thru 0x2515ceb data_size 0x35(0xf30e bytes) 2024-09-18T00:32:49.732 INFO:teuthology.orchestra.run.smithi081.stdout:5093 punch from 0x65cd191 to 0x65d46e2, (0x7551 bytes) 2024-09-18T00:32:49.745 INFO:teuthology.orchestra.run.smithi081.stdout:5095 writesame 0xd080e54 thru 0xd089366 data_size 0x13(0x8513 bytes) 2024-09-18T00:32:49.746 INFO:teuthology.orchestra.run.smithi081.stdout:5096 clone 42 order 21 su 131072 sc 13 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.219893632999998, 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:32:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:32:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:32:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:32:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:32:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.075507176999999, 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.050190348000001, 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:32:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:32:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:32:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.926325929000001, 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:32:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.847617243000002, 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:32:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:32:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.847460957999999, 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:32:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.847276633999996, 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.729158280999997, 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:32:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:32:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.570984858999999, 2024-09-18T00:32:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:32:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.570006925000001, 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:32:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:32:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.569280313, 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:32:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:32:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.685433547999999, 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:32:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.684391658000003, 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:32:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.679366971, 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:32:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:32:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.140149186999999, 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:32:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.710524693, 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:32:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:32:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.5102798420000001, 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:32:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:32:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.4426214319999999, 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:32:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:32:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.40831862000000002, 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:32:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:32:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.40755604899999998, 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:32:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:32:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:32:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:32:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:32:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:32:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:32:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:32:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:32:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:32:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:32:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:32:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:49.856 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:49.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:49.859 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:49.855+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:49.959 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:49.957+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:50.002 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:50.002 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:50.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:50.059 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:50.058+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:50.113 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:50.114 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:50.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:50.166 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:50.165+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:50.233 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.263853578000003, 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.263473920999999, 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.262644737999999, 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.255860134999999, 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.255839668999997, 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.255815579999997, 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.253969617999999, 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.253905799000002, 2024-09-18T00:32:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.253876919, 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.253851943000001, 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.253832891000002, 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.251884093999998, 2024-09-18T00:32:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.251861636999998, 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.251833197000003, 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.251810888999998, 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.251790436999997, 2024-09-18T00:32:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.250960988000003, 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.250920063000002, 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.250878815999997, 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.250856151000001, 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:50.336 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:50.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:50.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:50.339 INFO:teuthology.orchestra.run.smithi081.stdout:flattening image image_client.0-clone41 2024-09-18T00:32:50.340 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:50.337+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:50.439 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:50.437+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:50.486 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:50.487 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:50.496 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:50.541 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:50.539+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:50.547 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:50.570 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:50.597 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:50.626 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:50.626 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:50.635 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:50.635 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:50.635 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:50.635 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:50.635 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:50.640 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:50.638+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:50.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:50.651 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:50.652 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:50.677 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:50.677 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:50.699 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:50.733 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:50.734 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:50.741 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:50.738+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:50.817 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:50.817 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:50.826 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:50.868 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:50.866+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:50.943 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:50.941+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:50.974 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:50.975 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:50.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:51.015 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-18T00:32:51.044 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:51.042+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:51.145 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:51.142+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:51.162 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:51.162 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:51.171 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:51.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:32:51.186 INFO:teuthology.orchestra.run.smithi081.stdout:5097 trunc from 0xd089367 to 0x948324e 2024-09-18T00:32:51.211 INFO:teuthology.orchestra.run.smithi081.stdout:5099 read 0x77de58b thru 0x77eb616 (0xd08c bytes) 2024-09-18T00:32:51.211 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.211 INFO:teuthology.orchestra.run.smithi081.stdout:5101 punch from 0x3594e34 to 0x359b84d, (0x6a19 bytes) 2024-09-18T00:32:51.211 INFO:teuthology.orchestra.run.smithi081.stdout:5102 writesame 0x34088bc thru 0x34139c5 data_size 0x3e(0xb10a bytes) 2024-09-18T00:32:51.222 INFO:teuthology.orchestra.run.smithi081.stdout:5103 write 0xa433c25 thru 0xa434c57 (0x1033 bytes) 2024-09-18T00:32:51.225 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.225 INFO:teuthology.orchestra.run.smithi081.stdout:5107 read 0x947081d thru 0x947f794 (0xef78 bytes) 2024-09-18T00:32:51.225 INFO:teuthology.orchestra.run.smithi081.stdout:5109 punch from 0x489574c to 0x48a363e, (0xdef2 bytes) 2024-09-18T00:32:51.226 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.226 INFO:teuthology.orchestra.run.smithi081.stdout:5111 read 0x2200c66 thru 0x220f337 (0xe6d2 bytes) 2024-09-18T00:32:51.226 INFO:teuthology.orchestra.run.smithi081.stdout:5112 write 0x19bac2b thru 0x19c96e0 (0xeab6 bytes) 2024-09-18T00:32:51.238 INFO:teuthology.orchestra.run.smithi081.stdout:5113 write 0xa7cde76 thru 0xa7d6580 (0x870b bytes) 2024-09-18T00:32:51.242 INFO:teuthology.orchestra.run.smithi081.stdout:5114 trunc from 0xa7d6581 to 0x95689be 2024-09-18T00:32:51.245 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:51.244+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:51.255 INFO:teuthology.orchestra.run.smithi081.stdout:5116 write 0x4c48db8 thru 0x4c578dd (0xeb26 bytes) 2024-09-18T00:32:51.259 INFO:teuthology.orchestra.run.smithi081.stdout:5117 write 0x86c0336 thru 0x86c1324 (0xfef bytes) 2024-09-18T00:32:51.261 INFO:teuthology.orchestra.run.smithi081.stdout:5118 write 0x2ea85a9 thru 0x2eaa821 (0x2279 bytes) 2024-09-18T00:32:51.268 INFO:teuthology.orchestra.run.smithi081.stdout:5119 trunc from 0x95689be to 0x6ea1684 2024-09-18T00:32:51.303 INFO:teuthology.orchestra.run.smithi081.stdout:5120 write 0x752ad9c thru 0x7539fbc (0xf221 bytes) 2024-09-18T00:32:51.304 INFO:teuthology.orchestra.run.smithi081.stdout:5122 write 0x5da2ae8 thru 0x5da457a (0x1a93 bytes) 2024-09-18T00:32:51.309 INFO:teuthology.orchestra.run.smithi081.stdout:5123 read 0x72cc04 thru 0x73881b (0xbc18 bytes) 2024-09-18T00:32:51.309 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.320 INFO:teuthology.orchestra.run.smithi081.stdout:5125 write 0xad0deb8 thru 0xad13a36 (0x5b7f bytes) 2024-09-18T00:32:51.323 INFO:teuthology.orchestra.run.smithi081.stdout:5128 writesame 0x915ff7 thru 0x91f73e data_size 0x67(0x9748 bytes) 2024-09-18T00:32:51.329 INFO:teuthology.orchestra.run.smithi081.stdout:5129 read 0x3519c4d thru 0x3524226 (0xa5da bytes) 2024-09-18T00:32:51.329 INFO:teuthology.orchestra.run.smithi081.stdout:5130 trunc from 0xad13a37 to 0xab20b06 2024-09-18T00:32:51.330 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:51.330 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:5132 punch from 0x8d5c614 to 0x8d5f41c, (0x2e08 bytes) 2024-09-18T00:32:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.338 INFO:teuthology.orchestra.run.smithi081.stdout:5134 write 0x555e1ab thru 0x556725d (0x90b3 bytes) 2024-09-18T00:32:51.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:51.344 INFO:teuthology.orchestra.run.smithi081.stdout:5135 read 0x2faa1f6 thru 0x2fb782f (0xd63a bytes) 2024-09-18T00:32:51.344 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.346 INFO:teuthology.orchestra.run.smithi081.stdout:5139 trunc from 0xab20b06 to 0xc12e040 2024-09-18T00:32:51.352 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.352 INFO:teuthology.orchestra.run.smithi081.stdout:5141 writesame 0x962d64e thru 0x962ef3a data_size 0x9(0x18ed bytes) 2024-09-18T00:32:51.355 INFO:teuthology.orchestra.run.smithi081.stdout:5143 write 0x19e61cc thru 0x19e666d (0x4a2 bytes) 2024-09-18T00:32:51.363 INFO:teuthology.orchestra.run.smithi081.stdout:5144 read 0x9154b1d thru 0x915d2ed (0x87d1 bytes) 2024-09-18T00:32:51.364 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.364 INFO:teuthology.orchestra.run.smithi081.stdout:5147 writesame 0x402d394 thru 0x402fce0 data_size 0x1(0x294d bytes) 2024-09-18T00:32:51.374 INFO:teuthology.orchestra.run.smithi081.stdout:5148 write 0x3a04824 thru 0x3a07672 (0x2e4f bytes) 2024-09-18T00:32:51.378 INFO:teuthology.orchestra.run.smithi081.stdout:5149 read 0x66d4623 thru 0x66e32fc (0xecda bytes) 2024-09-18T00:32:51.378 INFO:teuthology.orchestra.run.smithi081.stdout:5150 read 0x9d000fd thru 0x9d03d33 (0x3c37 bytes) 2024-09-18T00:32:51.378 INFO:teuthology.orchestra.run.smithi081.stdout:5152 read 0xaf79ed5 thru 0xaf7c541 (0x266d bytes) 2024-09-18T00:32:51.379 INFO:teuthology.orchestra.run.smithi081.stdout:5155 read 0x431f7b5 thru 0x4325045 (0x5891 bytes) 2024-09-18T00:32:51.379 INFO:teuthology.orchestra.run.smithi081.stdout:5156 read 0x6b2ebf0 thru 0x6b3e9e7 (0xfdf8 bytes) 2024-09-18T00:32:51.379 INFO:teuthology.orchestra.run.smithi081.stdout:5157 read 0xeef14c thru 0xefee23 (0xfcd8 bytes) 2024-09-18T00:32:51.379 INFO:teuthology.orchestra.run.smithi081.stdout:5161 writesame 0x56b968a thru 0x56bb06e data_size 0x1(0x19e5 bytes) 2024-09-18T00:32:51.383 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:51.381+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:51.385 INFO:teuthology.orchestra.run.smithi081.stdout:5163 punch from 0x1550433 to 0x1553b7b, (0x3748 bytes) 2024-09-18T00:32:51.386 INFO:teuthology.orchestra.run.smithi081.stdout:5165 read 0x8101913 thru 0x810aad6 (0x91c4 bytes) 2024-09-18T00:32:51.386 INFO:teuthology.orchestra.run.smithi081.stdout:5166 write 0x8b9fe52 thru 0x8bad9e8 (0xdb97 bytes) 2024-09-18T00:32:51.390 INFO:teuthology.orchestra.run.smithi081.stdout:5167 writesame 0x978f7cb thru 0x9796dde data_size 0x42(0x7614 bytes) 2024-09-18T00:32:51.394 INFO:teuthology.orchestra.run.smithi081.stdout:5169 read 0x46ad63 thru 0x477863 (0xcb01 bytes) 2024-09-18T00:32:51.394 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.394 INFO:teuthology.orchestra.run.smithi081.stdout:5171 read 0x8e56ae6 thru 0x8e59821 (0x2d3c bytes) 2024-09-18T00:32:51.394 INFO:teuthology.orchestra.run.smithi081.stdout:5172 read 0x576ec42 thru 0x5773c13 (0x4fd2 bytes) 2024-09-18T00:32:51.395 INFO:teuthology.orchestra.run.smithi081.stdout:5174 read 0xb8ee1c0 thru 0xb8f7e27 (0x9c68 bytes) 2024-09-18T00:32:51.395 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.402 INFO:teuthology.orchestra.run.smithi081.stdout:5176 trunc from 0xc12e040 to 0x5631048 2024-09-18T00:32:51.435 INFO:teuthology.orchestra.run.smithi081.stdout:5178 trunc from 0x5631048 to 0x3945009 2024-09-18T00:32:51.447 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:51.445+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:51.462 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:51.462 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:51.462 INFO:teuthology.orchestra.run.smithi081.stdout:5181 read 0x1b188de thru 0x1b21d9d (0x94c0 bytes) 2024-09-18T00:32:51.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:51.471 INFO:teuthology.orchestra.run.smithi081.stdout:5182 writesame 0x5e0b658 thru 0x5e1465c data_size 0x17(0x9005 bytes) 2024-09-18T00:32:51.472 INFO:teuthology.orchestra.run.smithi081.stdout:5183 read 0x1aa678a thru 0x1aa706a (0x8e1 bytes) 2024-09-18T00:32:51.487 INFO:teuthology.orchestra.run.smithi081.stdout:5185 writesame 0xeda7999 thru 0xedb5abe data_size 0x2e(0xe126 bytes) 2024-09-18T00:32:51.487 INFO:teuthology.orchestra.run.smithi081.stdout:5186 read 0x57a5b86 thru 0x57b2329 (0xc7a4 bytes) 2024-09-18T00:32:51.487 INFO:teuthology.orchestra.run.smithi081.stdout:5187 writesame 0x6c71b69 thru 0x6c7aadd data_size 0x19(0x8f75 bytes) 2024-09-18T00:32:51.490 INFO:teuthology.orchestra.run.smithi081.stdout:5188 writesame 0x2e6667c thru 0x2e71bf8 data_size 0x11(0xb57d bytes) 2024-09-18T00:32:51.495 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.496 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.496 INFO:teuthology.orchestra.run.smithi081.stdout:5193 read 0xe74fa8 thru 0xe7a99e (0x59f7 bytes) 2024-09-18T00:32:51.496 INFO:teuthology.orchestra.run.smithi081.stdout:5194 write 0xd9ebc01 thru 0xd9f7e05 (0xc205 bytes) 2024-09-18T00:32:51.499 INFO:teuthology.orchestra.run.smithi081.stdout:5195 read 0xe6a2278 thru 0xe6a60ce (0x3e57 bytes) 2024-09-18T00:32:51.502 INFO:teuthology.orchestra.run.smithi081.stdout:5197 trunc from 0xedb5abf to 0xbf49fed 2024-09-18T00:32:51.522 INFO:teuthology.orchestra.run.smithi081.stdout:5198 trunc from 0xbf49fed to 0x35d9bd2 2024-09-18T00:32:51.539 INFO:teuthology.orchestra.run.smithi081.stdout:5199 trunc from 0x35d9bd2 to 0x1b3a67f 2024-09-18T00:32:51.548 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:51.547+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:51.588 INFO:teuthology.orchestra.run.smithi081.stdout:5200 write 0x62cb799 thru 0x62d2b06 (0x736e bytes) 2024-09-18T00:32:51.604 INFO:teuthology.orchestra.run.smithi081.stdout:5202 write 0xbc0ae64 thru 0xbc1ad1f (0xfebc bytes) 2024-09-18T00:32:51.607 INFO:teuthology.orchestra.run.smithi081.stdout:5203 writesame 0x50fb1fa thru 0x50fdddd data_size 0x4(0x2be4 bytes) 2024-09-18T00:32:51.611 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.611 INFO:teuthology.orchestra.run.smithi081.stdout:5205 read 0x1faeb26 thru 0x1faf748 (0xc23 bytes) 2024-09-18T00:32:51.611 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.612 INFO:teuthology.orchestra.run.smithi081.stdout:5207 writesame 0x5dabc4c thru 0x5daf3fd data_size 0x1(0x37b2 bytes) 2024-09-18T00:32:51.621 INFO:teuthology.orchestra.run.smithi081.stdout:5208 write 0x9228b55 thru 0x92380df (0xf58b bytes) 2024-09-18T00:32:51.625 INFO:teuthology.orchestra.run.smithi081.stdout:5209 writesame 0x743d198 thru 0x744a7db data_size 0x2a(0xd644 bytes) 2024-09-18T00:32:51.630 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:51.630 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:51.639 INFO:teuthology.orchestra.run.smithi081.stdout:5211 write 0xd02169e thru 0xd02ce1c (0xb77f bytes) 2024-09-18T00:32:51.640 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:51.649 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:51.648+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:51.654 INFO:teuthology.orchestra.run.smithi081.stdout:5212 trunc from 0xd02ce1d to 0x2f8e991 2024-09-18T00:32:51.685 INFO:teuthology.orchestra.run.smithi081.stdout:5213 trunc from 0x2f8e991 to 0x922d3e0 2024-09-18T00:32:51.691 INFO:teuthology.orchestra.run.smithi081.stdout:5215 punch from 0x5b4f5aa to 0x5b5107f, (0x1ad5 bytes) 2024-09-18T00:32:51.697 INFO:teuthology.orchestra.run.smithi081.stdout:5216 write 0x9c23d26 thru 0x9c30af0 (0xcdcb bytes) 2024-09-18T00:32:51.701 INFO:teuthology.orchestra.run.smithi081.stdout:5217 read 0x7eea642 thru 0x7ef5a72 (0xb431 bytes) 2024-09-18T00:32:51.701 INFO:teuthology.orchestra.run.smithi081.stdout:5218 read 0x240aab9 thru 0x2417f2b (0xd473 bytes) 2024-09-18T00:32:51.701 INFO:teuthology.orchestra.run.smithi081.stdout:5219 read 0x7f7d625 thru 0x7f86188 (0x8b64 bytes) 2024-09-18T00:32:51.701 INFO:teuthology.orchestra.run.smithi081.stdout:5221 write 0x7b1abed thru 0x7b1cd27 (0x213b bytes) 2024-09-18T00:32:51.704 INFO:teuthology.orchestra.run.smithi081.stdout:5222 read 0x5aceb3d thru 0x5ad7ef4 (0x93b8 bytes) 2024-09-18T00:32:51.704 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.704 INFO:teuthology.orchestra.run.smithi081.stdout:5225 writesame 0x204af31 thru 0x2055e68 data_size 0x3f(0xaf38 bytes) 2024-09-18T00:32:51.715 INFO:teuthology.orchestra.run.smithi081.stdout:5226 trunc from 0x9c30af1 to 0x29c2fb7 2024-09-18T00:32:51.735 INFO:teuthology.orchestra.run.smithi081.stdout:5227 write 0x8754de thru 0x87ee2c (0x994f bytes) 2024-09-18T00:32:51.750 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:51.747+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:51.751 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:51.751 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:51.751 INFO:teuthology.orchestra.run.smithi081.stdout:5228 write 0x463a473 thru 0x463eba7 (0x4735 bytes) 2024-09-18T00:32:51.755 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.755 INFO:teuthology.orchestra.run.smithi081.stdout:5230 writesame 0x2547a78 thru 0x254e2d5 data_size 0x6(0x685e bytes) 2024-09-18T00:32:51.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:51.761 INFO:teuthology.orchestra.run.smithi081.stdout:5231 read 0x2d115f5 thru 0x2d1af9e (0x99aa bytes) 2024-09-18T00:32:51.761 INFO:teuthology.orchestra.run.smithi081.stdout:5232 read 0x2f8c4e1 thru 0x2f90be0 (0x4700 bytes) 2024-09-18T00:32:51.761 INFO:teuthology.orchestra.run.smithi081.stdout:5234 write 0x2914da9 thru 0x292340f (0xe667 bytes) 2024-09-18T00:32:51.778 INFO:teuthology.orchestra.run.smithi081.stdout:5235 write 0xb84c6b1 thru 0xb85b0d6 (0xea26 bytes) 2024-09-18T00:32:51.781 INFO:teuthology.orchestra.run.smithi081.stdout:5236 write 0xac45bf9 thru 0xac55988 (0xfd90 bytes) 2024-09-18T00:32:51.796 INFO:teuthology.orchestra.run.smithi081.stdout:5238 trunc from 0xb85b0d7 to 0x10d4462 2024-09-18T00:32:51.830 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.835 INFO:teuthology.orchestra.run.smithi081.stdout:5240 write 0x10d2583 thru 0x10d930d (0x6d8b bytes) 2024-09-18T00:32:51.845 INFO:teuthology.orchestra.run.smithi081.stdout:5241 writesame 0x382ab21 thru 0x383101b data_size 0x7(0x64fb bytes) 2024-09-18T00:32:51.845 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.846 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.851 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:51.849+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:51.859 INFO:teuthology.orchestra.run.smithi081.stdout:5245 write 0x9c3b115 thru 0x9c48e45 (0xdd31 bytes) 2024-09-18T00:32:51.864 INFO:teuthology.orchestra.run.smithi081.stdout:5246 punch from 0x7cb7f82 to 0x7cc0786, (0x8804 bytes) 2024-09-18T00:32:51.864 INFO:teuthology.orchestra.run.smithi081.stdout:5247 read 0x4163101 thru 0x4167fde (0x4ede bytes) 2024-09-18T00:32:51.864 INFO:teuthology.orchestra.run.smithi081.stdout:5248 punch from 0x701c40a to 0x7023003, (0x6bf9 bytes) 2024-09-18T00:32:51.864 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.871 INFO:teuthology.orchestra.run.smithi081.stdout:5251 trunc from 0x9c48e46 to 0x3236f4a 2024-09-18T00:32:51.882 INFO:teuthology.orchestra.run.smithi081.stdout:5252 read 0x3e3138 thru 0x3ee0e2 (0xafab bytes) 2024-09-18T00:32:51.900 INFO:teuthology.orchestra.run.smithi081.stdout:5255 write 0xd0e535a thru 0xd0eeaf0 (0x9797 bytes) 2024-09-18T00:32:51.908 INFO:teuthology.orchestra.run.smithi081.stdout:5256 writesame 0xd8fec85 thru 0xd905adc data_size 0x84(0x6e58 bytes) 2024-09-18T00:32:51.910 INFO:teuthology.orchestra.run.smithi081.stdout:5257 punch from 0x32b6898 to 0x32c1e71, (0xb5d9 bytes) 2024-09-18T00:32:51.910 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.910 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.910 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.910 INFO:teuthology.orchestra.run.smithi081.stdout:5263 write 0x7306f9d thru 0x7314a07 (0xda6b bytes) 2024-09-18T00:32:51.913 INFO:teuthology.orchestra.run.smithi081.stdout:5264 read 0x88bc67b thru 0x88cc556 (0xfedc bytes) 2024-09-18T00:32:51.913 INFO:teuthology.orchestra.run.smithi081.stdout:5265 read 0x24e8c25 thru 0x24eb330 (0x270c bytes) 2024-09-18T00:32:51.914 INFO:teuthology.orchestra.run.smithi081.stdout:5267 writesame 0x5502eaf thru 0x550726e data_size 0x20(0x43c0 bytes) 2024-09-18T00:32:51.916 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:51.916 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:51.918 INFO:teuthology.orchestra.run.smithi081.stdout:5268 punch from 0xbce4d6d to 0xbcefd04, (0xaf97 bytes) 2024-09-18T00:32:51.918 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.918 INFO:teuthology.orchestra.run.smithi081.stdout:5271 read 0x7080d41 thru 0x7083233 (0x24f3 bytes) 2024-09-18T00:32:51.918 INFO:teuthology.orchestra.run.smithi081.stdout:5272 write 0x5928058 thru 0x5934f33 (0xcedc bytes) 2024-09-18T00:32:51.921 INFO:teuthology.orchestra.run.smithi081.stdout:5273 read 0x64df708 thru 0x64e735d (0x7c56 bytes) 2024-09-18T00:32:51.921 INFO:teuthology.orchestra.run.smithi081.stdout:5274 read 0xb2052a8 thru 0xb210575 (0xb2ce bytes) 2024-09-18T00:32:51.922 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:51.922 INFO:teuthology.orchestra.run.smithi081.stdout:5276 write 0x8824e97 thru 0x8831a53 (0xcbbd bytes) 2024-09-18T00:32:51.924 INFO:teuthology.orchestra.run.smithi081.stdout:5277 read 0x28bd9a6 thru 0x28c0a6a (0x30c5 bytes) 2024-09-18T00:32:51.924 INFO:teuthology.orchestra.run.smithi081.stdout:5278 read 0x57fba2c thru 0x58083aa (0xc97f bytes) 2024-09-18T00:32:51.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:51.932 INFO:teuthology.orchestra.run.smithi081.stdout:5279 trunc from 0xd905add to 0x70ec66a 2024-09-18T00:32:51.952 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:51.950+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:51.956 INFO:teuthology.orchestra.run.smithi081.stdout:5280 trunc from 0x70ec66a to 0x284131e 2024-09-18T00:32:51.973 INFO:teuthology.orchestra.run.smithi081.stdout:5281 read 0x1ac723e thru 0x1acb6f8 (0x44bb bytes) 2024-09-18T00:32:51.978 INFO:teuthology.orchestra.run.smithi081.stdout:5282 trunc from 0x284131e to 0x6e054ff 2024-09-18T00:32:51.985 INFO:teuthology.orchestra.run.smithi081.stdout:5283 write 0x2024aba thru 0x202fc7b (0xb1c2 bytes) 2024-09-18T00:32:51.996 INFO:teuthology.orchestra.run.smithi081.stdout:5284 write 0x852432a thru 0x85243fd (0xd4 bytes) 2024-09-18T00:32:52.010 INFO:teuthology.orchestra.run.smithi081.stdout:5285 write 0xc95f1c0 thru 0xc96e3df (0xf220 bytes) 2024-09-18T00:32:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.030 INFO:teuthology.orchestra.run.smithi081.stdout:5290 trunc from 0xc96e3e0 to 0x1ef0bd3 2024-09-18T00:32:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.036 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.044 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.046 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:52.053 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:52.051+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:52.063 INFO:teuthology.orchestra.run.smithi081.stdout:5292 writesame 0xbad033f thru 0xbad7e26 data_size 0x8a(0x7ae8 bytes) 2024-09-18T00:32:52.064 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.064 INFO:teuthology.orchestra.run.smithi081.stdout:5295 writesame 0xb831712 thru 0xb83a31a data_size 0x1(0x8c09 bytes) 2024-09-18T00:32:52.089 INFO:teuthology.orchestra.run.smithi081.stdout:5297 trunc from 0xbad7e27 to 0x627caf8 2024-09-18T00:32:52.101 INFO:teuthology.orchestra.run.smithi081.stdout:5299 punch from 0x140cb0 to 0x14add9, (0xa129 bytes) 2024-09-18T00:32:52.101 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.109 INFO:teuthology.orchestra.run.smithi081.stdout:5301 write 0x81b381b thru 0x81b7f56 (0x473c bytes) 2024-09-18T00:32:52.111 INFO:teuthology.orchestra.run.smithi081.stdout:5302 clone 43 order 19 su 8192 sc 7 2024-09-18T00:32:52.152 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.152 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.154 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:52.152+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:52.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:32:52.239 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone42 from 0x81b7f57 (overlap 0x10d4462) to 0x35da7a 2024-09-18T00:32:52.255 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:52.253+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:52.303 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-18T00:32:52.357 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:52.354+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:52.427 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.427 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:52.457 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:52.455+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:52.546 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.546 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:52.558 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:52.556+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:52.610 INFO:teuthology.orchestra.run.smithi081.stdout:5303 punch from 0x737ec05 to 0x7380fd7, (0x23d2 bytes) 2024-09-18T00:32:52.624 INFO:teuthology.orchestra.run.smithi081.stdout:5304 writesame 0xbd816cc thru 0xbd868b8 data_size 0x1(0x51ed bytes) 2024-09-18T00:32:52.624 INFO:teuthology.orchestra.run.smithi081.stdout:5305 writesame 0xb1b9326 thru 0xb1c7ac8 data_size 0x1(0xe7a3 bytes) 2024-09-18T00:32:52.658 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:52.657+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:52.668 INFO:teuthology.orchestra.run.smithi081.stdout:5306 write 0x249fd3 thru 0x24a32b (0x359 bytes) 2024-09-18T00:32:52.679 INFO:teuthology.orchestra.run.smithi081.stdout:5307 read 0x2e59a8 thru 0x2f2438 (0xca91 bytes) 2024-09-18T00:32:52.679 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.679 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.680 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.681 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.681 INFO:teuthology.orchestra.run.smithi081.stdout:5313 write 0x4f51d6f thru 0x4f5e303 (0xc595 bytes) 2024-09-18T00:32:52.689 INFO:teuthology.orchestra.run.smithi081.stdout:5315 write 0x943e125 thru 0x943f3db (0x12b7 bytes) 2024-09-18T00:32:52.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:52.692 INFO:teuthology.orchestra.run.smithi081.stdout:5316 write 0x25905cf thru 0x2593cf1 (0x3723 bytes) 2024-09-18T00:32:52.697 INFO:teuthology.orchestra.run.smithi081.stdout:5317 punch from 0x5cb76b5 to 0x5cc2a2e, (0xb379 bytes) 2024-09-18T00:32:52.697 INFO:teuthology.orchestra.run.smithi081.stdout:5318 writesame 0x1331e2b thru 0x1332a1e data_size 0x14(0xbf4 bytes) 2024-09-18T00:32:52.705 INFO:teuthology.orchestra.run.smithi081.stdout:5319 writesame 0x3378c52 thru 0x3384198 data_size 0x1f(0xb547 bytes) 2024-09-18T00:32:52.715 INFO:teuthology.orchestra.run.smithi081.stdout:5320 read 0x771a5e2 thru 0x771c575 (0x1f94 bytes) 2024-09-18T00:32:52.715 INFO:teuthology.orchestra.run.smithi081.stdout:5321 punch from 0x842ea33 to 0x8437616, (0x8be3 bytes) 2024-09-18T00:32:52.715 INFO:teuthology.orchestra.run.smithi081.stdout:5323 read 0xb29a172 thru 0xb2a8007 (0xde96 bytes) 2024-09-18T00:32:52.715 INFO:teuthology.orchestra.run.smithi081.stdout:5324 writesame 0x61babc6 thru 0x61c4076 data_size 0x17(0x94b1 bytes) 2024-09-18T00:32:52.723 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.723 INFO:teuthology.orchestra.run.smithi081.stdout:5326 write 0x2bef9e4 thru 0x2bff11c (0xf739 bytes) 2024-09-18T00:32:52.740 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.740 INFO:teuthology.orchestra.run.smithi081.stdout:5328 read 0x940ed66 thru 0x941e5a0 (0xf83b bytes) 2024-09-18T00:32:52.741 INFO:teuthology.orchestra.run.smithi081.stdout:5329 write 0x453ab5a thru 0x454434b (0x97f2 bytes) 2024-09-18T00:32:52.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:52.759 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:52.758+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:52.761 INFO:teuthology.orchestra.run.smithi081.stdout:5330 writesame 0xe6fe3f1 thru 0xe703e21 data_size 0x1(0x5a31 bytes) 2024-09-18T00:32:52.762 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.762 INFO:teuthology.orchestra.run.smithi081.stdout:5333 read 0xb33590 thru 0xb355f9 (0x206a bytes) 2024-09-18T00:32:52.762 INFO:teuthology.orchestra.run.smithi081.stdout:5334 write 0x7cb61a7 thru 0x7cb6b25 (0x97f bytes) 2024-09-18T00:32:52.767 INFO:teuthology.orchestra.run.smithi081.stdout:5335 write 0x771cab thru 0x77661d (0x4973 bytes) 2024-09-18T00:32:52.785 INFO:teuthology.orchestra.run.smithi081.stdout:5336 trunc from 0xe703e22 to 0xe2ebb75 2024-09-18T00:32:52.793 INFO:teuthology.orchestra.run.smithi081.stdout:5337 write 0xc0b6899 thru 0xc0bd4bd (0x6c25 bytes) 2024-09-18T00:32:52.803 INFO:teuthology.orchestra.run.smithi081.stdout:5338 read 0xc287f83 thru 0xc291804 (0x9882 bytes) 2024-09-18T00:32:52.804 INFO:teuthology.orchestra.run.smithi081.stdout:5340 read 0x1b418f4 thru 0x1b4985f (0x7f6c bytes) 2024-09-18T00:32:52.805 INFO:teuthology.orchestra.run.smithi081.stdout:5341 punch from 0x88fea09 to 0x890db5b, (0xf152 bytes) 2024-09-18T00:32:52.805 INFO:teuthology.orchestra.run.smithi081.stdout:5343 read 0xb2e0027 thru 0xb2e40d4 (0x40ae bytes) 2024-09-18T00:32:52.812 INFO:teuthology.orchestra.run.smithi081.stdout:5344 trunc from 0xe2ebb75 to 0x930f5b0 2024-09-18T00:32:52.822 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:52.822 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:52.823 INFO:teuthology.orchestra.run.smithi081.stdout:5346 read 0x710a32c thru 0x7114c41 (0xa916 bytes) 2024-09-18T00:32:52.827 INFO:teuthology.orchestra.run.smithi081.stdout:5347 trunc from 0x930f5b0 to 0x6bf2430 2024-09-18T00:32:52.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:52.854 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.854 INFO:teuthology.orchestra.run.smithi081.stdout:5349 read 0x210d07e thru 0x210e67c (0x15ff bytes) 2024-09-18T00:32:52.854 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.854 INFO:teuthology.orchestra.run.smithi081.stdout:5352 read 0x30ad149 thru 0x30bccd2 (0xfb8a bytes) 2024-09-18T00:32:52.854 INFO:teuthology.orchestra.run.smithi081.stdout:5353 write 0x1c80689 thru 0x1c8acde (0xa656 bytes) 2024-09-18T00:32:52.860 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:52.858+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:52.864 INFO:teuthology.orchestra.run.smithi081.stdout:5355 trunc from 0x6bf2430 to 0x6c7dd92 2024-09-18T00:32:52.880 INFO:teuthology.orchestra.run.smithi081.stdout:5356 write 0xa7d33f6 thru 0xa7d3a7c (0x687 bytes) 2024-09-18T00:32:52.883 INFO:teuthology.orchestra.run.smithi081.stdout:5357 write 0x4becdff thru 0x4bf8c37 (0xbe39 bytes) 2024-09-18T00:32:52.893 INFO:teuthology.orchestra.run.smithi081.stdout:5360 trunc from 0xa7d3a7d to 0xa80ef96 2024-09-18T00:32:52.895 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:52.895 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:52.897 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:52.901 INFO:teuthology.orchestra.run.smithi081.stdout:5364 trunc from 0xa80ef96 to 0xd6fb51c 2024-09-18T00:32:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:52.915 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:52.920 INFO:teuthology.orchestra.run.smithi081.stdout:5366 trunc from 0xd6fb51c to 0x1fb8b66 2024-09-18T00:32:52.939 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:52.952 INFO:teuthology.orchestra.run.smithi081.stdout:5367 read 0x460668 thru 0x46e2d7 (0xdc70 bytes) 2024-09-18T00:32:52.954 INFO:teuthology.orchestra.run.smithi081.stdout:5368 read 0x132a406 thru 0x13389db (0xe5d6 bytes) 2024-09-18T00:32:52.961 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:52.959+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:52.962 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:52.969 INFO:teuthology.orchestra.run.smithi081.stdout:5369 write 0x92e41ba thru 0x92e5aa0 (0x18e7 bytes) 2024-09-18T00:32:52.972 INFO:teuthology.orchestra.run.smithi081.stdout:5373 write 0x7fd56bf thru 0x7fda681 (0x4fc3 bytes) 2024-09-18T00:32:52.978 INFO:teuthology.orchestra.run.smithi081.stdout:5375 write 0x714d914 thru 0x714e1b9 (0x8a6 bytes) 2024-09-18T00:32:52.982 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:52.986 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.515117941, 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:32:52.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514827226000001, 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:52.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:32:52.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:32:52.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:52.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:32:52.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:32:52.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:52.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514780766999998, 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:32:52.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:52.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:32:53.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:32:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514757271000001, 2024-09-18T00:32:53.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:53.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:32:53.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514734765999997, 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:32:53.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:32:53.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514224816000002, 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:32:53.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514174728, 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:32:53.016 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:32:53.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514143357999998, 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:32:53.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:53.025 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514121271, 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:32:53.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.514099233000003, 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:32:53.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:32:53.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512937211000001, 2024-09-18T00:32:53.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:53.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:32:53.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512905891000003, 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:32:53.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:32:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:53.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512874095000001, 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:32:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512848984000001, 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512805516999997, 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:32:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:32:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512783630000001, 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:32:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512726352000001, 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:32:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.512699263000002, 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:32:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.1820692250000002, 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.1820501969999997, 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:32:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:32:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.082 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:53.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:53.084 INFO:teuthology.orchestra.run.smithi081.stdout:5377 write 0xea43984 thru 0xea47be8 (0x4265 bytes) 2024-09-18T00:32:53.084 INFO:teuthology.orchestra.run.smithi081.stdout:5379 writesame 0xa12d615 thru 0xa12ee52 data_size 0x1d(0x183e bytes) 2024-09-18T00:32:53.085 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:53.085 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:53.085 INFO:teuthology.orchestra.run.smithi081.stdout:5380 flatten 2024-09-18T00:32:53.085 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:53.086 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:53.086 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:53.086 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:53.087 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:53.081+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:53.184 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:53.182+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:53.246 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:53.246 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:53.246 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:53.247 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:53.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:53.299 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:53.298+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:53.302 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.302 INFO:teuthology.orchestra.run.smithi081.stdout:5385 write 0x148238c thru 0x148df28 (0xbb9d bytes) 2024-09-18T00:32:53.310 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.310 INFO:teuthology.orchestra.run.smithi081.stdout:5387 write 0x6a28f4d thru 0x6a37851 (0xe905 bytes) 2024-09-18T00:32:53.323 INFO:teuthology.orchestra.run.smithi081.stdout:5388 read 0x9ba5278 thru 0x9ba6f13 (0x1c9c bytes) 2024-09-18T00:32:53.323 INFO:teuthology.orchestra.run.smithi081.stdout:5389 write 0x2796a36 thru 0x27988c5 (0x1e90 bytes) 2024-09-18T00:32:53.330 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.330 INFO:teuthology.orchestra.run.smithi081.stdout:5392 write 0xb3a31af thru 0xb3a65e5 (0x3437 bytes) 2024-09-18T00:32:53.338 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.338 INFO:teuthology.orchestra.run.smithi081.stdout:5394 punch from 0xbc92f67 to 0xbc956c1, (0x275a bytes) 2024-09-18T00:32:53.338 INFO:teuthology.orchestra.run.smithi081.stdout:5396 read 0x33b8c5f thru 0x33c3df5 (0xb197 bytes) 2024-09-18T00:32:53.339 INFO:teuthology.orchestra.run.smithi081.stdout:5397 read 0x35b53b9 thru 0x35c2b4d (0xd795 bytes) 2024-09-18T00:32:53.339 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.346 INFO:teuthology.orchestra.run.smithi081.stdout:5399 trunc from 0xea47be9 to 0x88659df 2024-09-18T00:32:53.362 INFO:teuthology.orchestra.run.smithi081.stdout:5401 read 0xef443d thru 0xef95d1 (0x5195 bytes) 2024-09-18T00:32:53.368 INFO:teuthology.orchestra.run.smithi081.stdout:5402 trunc from 0x88659df to 0xd5686e4 2024-09-18T00:32:53.371 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:53.371 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:5403 read 0xb78babd thru 0xb796732 (0xac76 bytes) 2024-09-18T00:32:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:5404 writesame 0xa857617 thru 0xa85cd27 data_size 0x1(0x5711 bytes) 2024-09-18T00:32:53.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:53.387 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:53.385+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:5407 read 0x4906579 thru 0x490e6b7 (0x813f bytes) 2024-09-18T00:32:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:5408 read 0x42099b thru 0x427ded (0x7453 bytes) 2024-09-18T00:32:53.397 INFO:teuthology.orchestra.run.smithi081.stdout:5409 write 0xe7cf792 thru 0xe7d866d (0x8edc bytes) 2024-09-18T00:32:53.406 INFO:teuthology.orchestra.run.smithi081.stdout:5411 write 0x27f796b thru 0x27fb6ec (0x3d82 bytes) 2024-09-18T00:32:53.409 INFO:teuthology.orchestra.run.smithi081.stdout:5412 punch from 0x6425206 to 0x642c8c3, (0x76bd bytes) 2024-09-18T00:32:53.409 INFO:teuthology.orchestra.run.smithi081.stdout:5413 write 0x8b63c85 thru 0x8b69e9c (0x6218 bytes) 2024-09-18T00:32:53.417 INFO:teuthology.orchestra.run.smithi081.stdout:5414 punch from 0xa4eba64 to 0xa4f81e5, (0xc781 bytes) 2024-09-18T00:32:53.417 INFO:teuthology.orchestra.run.smithi081.stdout:5415 read 0x8b4f661 thru 0x8b58368 (0x8d08 bytes) 2024-09-18T00:32:53.418 INFO:teuthology.orchestra.run.smithi081.stdout:5416 writesame 0x22f1d9c thru 0x22f6210 data_size 0x1(0x4475 bytes) 2024-09-18T00:32:53.446 INFO:teuthology.orchestra.run.smithi081.stdout:5417 trunc from 0xe7d866e to 0x202b29f 2024-09-18T00:32:53.485 INFO:teuthology.orchestra.run.smithi081.stdout:5418 writesame 0xda3a76e thru 0xda4971f data_size 0x3f(0xefb2 bytes) 2024-09-18T00:32:53.486 INFO:teuthology.orchestra.run.smithi081.stdout:5419 read 0x341af65 thru 0x342892a (0xd9c6 bytes) 2024-09-18T00:32:53.486 INFO:teuthology.orchestra.run.smithi081.stdout:5420 punch from 0x2028dfa to 0x2034354, (0xb55a bytes) 2024-09-18T00:32:53.486 INFO:teuthology.orchestra.run.smithi081.stdout:5421 punch from 0x35c24f1 to 0x35c3ad6, (0x15e5 bytes) 2024-09-18T00:32:53.486 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.486 INFO:teuthology.orchestra.run.smithi081.stdout:5423 writesame 0xc2088da thru 0xc20f6c3 data_size 0xb(0x6dea bytes) 2024-09-18T00:32:53.487 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:53.485+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:53.492 INFO:teuthology.orchestra.run.smithi081.stdout:5424 read 0x67cfa49 thru 0x67d2221 (0x27d9 bytes) 2024-09-18T00:32:53.492 INFO:teuthology.orchestra.run.smithi081.stdout:5425 read 0x6182906 thru 0x6188a27 (0x6122 bytes) 2024-09-18T00:32:53.492 INFO:teuthology.orchestra.run.smithi081.stdout:5426 writesame 0x1dc92dc thru 0x1dd0bc7 data_size 0x4(0x78ec bytes) 2024-09-18T00:32:53.499 INFO:teuthology.orchestra.run.smithi081.stdout:5428 read 0x42d2e9d thru 0x42d845b (0x55bf bytes) 2024-09-18T00:32:53.499 INFO:teuthology.orchestra.run.smithi081.stdout:5430 read 0xb2171ce thru 0xb21ad82 (0x3bb5 bytes) 2024-09-18T00:32:53.499 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.499 INFO:teuthology.orchestra.run.smithi081.stdout:5435 write 0xd848fa6 thru 0xd84fd6b (0x6dc6 bytes) 2024-09-18T00:32:53.506 INFO:teuthology.orchestra.run.smithi081.stdout:5436 writesame 0x7ebd943 thru 0x7ec8aea data_size 0x3c(0xb1a8 bytes) 2024-09-18T00:32:53.514 INFO:teuthology.orchestra.run.smithi081.stdout:5437 write 0x504885a thru 0x504bc0f (0x33b6 bytes) 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:53.519 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.981773824000001, 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.837387368000002, 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:32:53.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.812070538999997, 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:32:53.528 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:32:53.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.688206119999997, 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:32:53.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.609497433999998, 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.541 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.609341149000002, 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.609156824999999, 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:32:53.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.491038472, 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:32:53.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.332865050000002, 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:53.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.331887115999997, 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:32:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:32:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.331160504000003, 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.447313739000002, 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:32:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.446271848999999, 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:32:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.441247162000003, 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:32:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:32:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.902029378000002, 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:32:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.472404883999999, 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2721600330000005, 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2045016229999996, 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:32:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:32:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.1701988109999997, 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:32:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.1694362399999996, 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:53.607 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:53.608 INFO:teuthology.orchestra.run.smithi081.stdout:5438 write 0x922e77f thru 0x9230177 (0x19f9 bytes) 2024-09-18T00:32:53.608 INFO:teuthology.orchestra.run.smithi081.stdout:5439 trunc from 0xda49720 to 0xdc4e790 2024-09-18T00:32:53.608 INFO:teuthology.orchestra.run.smithi081.stdout:5440 write 0x2dc637 thru 0x2e624f (0x9c19 bytes) 2024-09-18T00:32:53.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:53.610 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.610 INFO:teuthology.orchestra.run.smithi081.stdout:5442 writesame 0x66b9fe thru 0x6764be data_size 0x9(0xaac1 bytes) 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5447 trunc from 0xdc4e790 to 0x58ca055 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5448 punch from 0x1a76f0b to 0x1a77eed, (0xfe2 bytes) 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5450 trunc from 0x58ca055 to 0x57ffe3d 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5453 trunc from 0x57ffe3d to 0x7bf3836 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5454 punch from 0x3f450b3 to 0x3f528d0, (0xd81d bytes) 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5455 write 0xc334651 thru 0xc33c097 (0x7a47 bytes) 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5456 read 0xabf7220 thru 0xac01f73 (0xad54 bytes) 2024-09-18T00:32:53.611 INFO:teuthology.orchestra.run.smithi081.stdout:5457 writesame 0x4a0653e thru 0x4a12602 data_size 0x1(0xc0c5 bytes) 2024-09-18T00:32:53.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:53.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:53.611 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-18T00:32:53.612 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T00:32:53.612 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T00:32:53.612 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-18T00:32:53.613 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:53.612+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:53.635 INFO:teuthology.orchestra.run.smithi081.stdout:5459 read 0x8bbff11 thru 0x8bcac00 (0xacf0 bytes) 2024-09-18T00:32:53.636 INFO:teuthology.orchestra.run.smithi081.stdout:5461 read 0xb6be245 thru 0xb6cdf49 (0xfd05 bytes) 2024-09-18T00:32:53.636 INFO:teuthology.orchestra.run.smithi081.stdout:5464 writesame 0x1ed75f1 thru 0x1ee4d39 data_size 0x1(0xd749 bytes) 2024-09-18T00:32:53.681 INFO:teuthology.orchestra.run.smithi081.stdout:5466 read 0xb2187c thru 0xb310a6 (0xf82b bytes) 2024-09-18T00:32:53.681 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.681 INFO:teuthology.orchestra.run.smithi081.stdout:5468 write 0x1127d1e thru 0x11371a8 (0xf48b bytes) 2024-09-18T00:32:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:5470 write 0x19f5aa0 thru 0x19fc528 (0x6a89 bytes) 2024-09-18T00:32:53.697 INFO:teuthology.orchestra.run.smithi081.stdout:5472 read 0x5457bee thru 0x54630d0 (0xb4e3 bytes) 2024-09-18T00:32:53.697 INFO:teuthology.orchestra.run.smithi081.stdout:5473 write 0x3eb18e thru 0x3f006d (0x4ee0 bytes) 2024-09-18T00:32:53.699 INFO:teuthology.orchestra.run.smithi081.stdout:5474 write 0x1433053 thru 0x14334a8 (0x456 bytes) 2024-09-18T00:32:53.701 INFO:teuthology.orchestra.run.smithi081.stdout:5475 write 0xab4a616 thru 0xab4f770 (0x515b bytes) 2024-09-18T00:32:53.708 INFO:teuthology.orchestra.run.smithi081.stdout:5479 trunc from 0xc33c098 to 0xaea52f5 2024-09-18T00:32:53.714 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:53.712+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:53.722 INFO:teuthology.orchestra.run.smithi081.stdout:5480 punch from 0x76aa57c to 0x76b1260, (0x6ce4 bytes) 2024-09-18T00:32:53.724 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:53.724 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "" 2024-09-18T00:32:53.724 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:53.728 INFO:teuthology.orchestra.run.smithi081.stdout:5481 writesame 0xb0af421 thru 0xb0be761 data_size 0x1(0xf341 bytes) 2024-09-18T00:32:53.738 INFO:teuthology.orchestra.run.smithi081.stdout:5482 writesame 0xd631bc0 thru 0xd63fc9e data_size 0x3(0xe0df bytes) 2024-09-18T00:32:53.738 INFO:teuthology.orchestra.run.smithi081.stdout:5483 write 0xb0939ae thru 0xb0970a3 (0x36f6 bytes) 2024-09-18T00:32:53.745 INFO:teuthology.orchestra.run.smithi081.stdout:5484 writesame 0xc54a623 thru 0xc54e654 data_size 0x53(0x4032 bytes) 2024-09-18T00:32:53.748 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:53.749 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:53.749 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:53.749 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:53.750 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.750 INFO:teuthology.orchestra.run.smithi081.stdout:5488 read 0xca1fd2 thru 0xcacad7 (0xab06 bytes) 2024-09-18T00:32:53.750 INFO:teuthology.orchestra.run.smithi081.stdout:5489 punch from 0xacb8077 to 0xacc36da, (0xb663 bytes) 2024-09-18T00:32:53.750 INFO:teuthology.orchestra.run.smithi081.stdout:5490 punch from 0x553bc41 to 0x5549900, (0xdcbf bytes) 2024-09-18T00:32:53.755 INFO:teuthology.orchestra.run.smithi081.stdout:5491 writesame 0xda12f1c thru 0xda1d57e data_size 0x7(0xa663 bytes) 2024-09-18T00:32:53.755 INFO:teuthology.orchestra.run.smithi081.stdout:5493 read 0x862a882 thru 0x863853d (0xdcbc bytes) 2024-09-18T00:32:53.756 INFO:teuthology.orchestra.run.smithi081.stdout:5495 write 0xa1cdbfe thru 0xa1d8f1e (0xb321 bytes) 2024-09-18T00:32:53.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:53.769 INFO:teuthology.orchestra.run.smithi081.stdout:5496 write 0xde6335f thru 0xde64e63 (0x1b05 bytes) 2024-09-18T00:32:53.774 INFO:teuthology.orchestra.run.smithi081.stdout:5497 write 0xb95ea93 thru 0xb96e305 (0xf873 bytes) 2024-09-18T00:32:53.782 INFO:teuthology.orchestra.run.smithi081.stdout:5498 write 0x61bd84b thru 0x61cc156 (0xe90c bytes) 2024-09-18T00:32:53.791 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.791 INFO:teuthology.orchestra.run.smithi081.stdout:5502 write 0x27a728a thru 0x27aed18 (0x7a8f bytes) 2024-09-18T00:32:53.802 INFO:teuthology.orchestra.run.smithi081.stdout:5503 writesame 0x2f15819 thru 0x2f1cc23 data_size 0x1(0x740b bytes) 2024-09-18T00:32:53.814 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:53.813+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:53.824 INFO:teuthology.orchestra.run.smithi081.stdout:5505 write 0x1b9c8ae thru 0x1ba3c96 (0x73e9 bytes) 2024-09-18T00:32:53.830 INFO:teuthology.orchestra.run.smithi081.stdout:5506 write 0x28b8491 thru 0x28c24a1 (0xa011 bytes) 2024-09-18T00:32:53.836 INFO:teuthology.orchestra.run.smithi081.stdout:5509 read 0x20c10ef thru 0x20cfff7 (0xef09 bytes) 2024-09-18T00:32:53.836 INFO:teuthology.orchestra.run.smithi081.stdout:5511 trunc from 0xde64e64 to 0xddc957d 2024-09-18T00:32:53.845 INFO:teuthology.orchestra.run.smithi081.stdout:5513 read 0x97427b6 thru 0x97448cc (0x2117 bytes) 2024-09-18T00:32:53.845 INFO:teuthology.orchestra.run.smithi081.stdout:5514 read 0x9394d21 thru 0x939b8b3 (0x6b93 bytes) 2024-09-18T00:32:53.845 INFO:teuthology.orchestra.run.smithi081.stdout:5518 read 0xd470c0a thru 0xd475aa0 (0x4e97 bytes) 2024-09-18T00:32:53.845 INFO:teuthology.orchestra.run.smithi081.stdout:5519 writesame 0x444343e thru 0x444711b data_size 0x15(0x3cde bytes) 2024-09-18T00:32:53.855 INFO:teuthology.orchestra.run.smithi081.stdout:5520 writesame 0x63d4107 thru 0x63dde1d data_size 0x23(0x9d17 bytes) 2024-09-18T00:32:53.865 INFO:teuthology.orchestra.run.smithi081.stdout:5521 write 0x6a699cf thru 0x6a6f554 (0x5b86 bytes) 2024-09-18T00:32:53.876 INFO:teuthology.orchestra.run.smithi081.stdout:5522 read 0x17d5207 thru 0x17d731d (0x2117 bytes) 2024-09-18T00:32:53.876 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.876 INFO:teuthology.orchestra.run.smithi081.stdout:5525 read 0xb0365ea thru 0xb037540 (0xf57 bytes) 2024-09-18T00:32:53.876 INFO:teuthology.orchestra.run.smithi081.stdout:5527 writesame 0xb7e9e77 thru 0xb7eaf98 data_size 0x2b(0x1122 bytes) 2024-09-18T00:32:53.878 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.878 INFO:teuthology.orchestra.run.smithi081.stdout:5529 write 0xd1f793e thru 0xd1ff8b2 (0x7f75 bytes) 2024-09-18T00:32:53.879 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:32:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:32:53.879 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:53.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:53.889 INFO:teuthology.orchestra.run.smithi081.stdout:5530 read 0xa554ae4 thru 0xa564a9b (0xffb8 bytes) 2024-09-18T00:32:53.890 INFO:teuthology.orchestra.run.smithi081.stdout:5532 punch from 0x3b9f1ad to 0x3bac578, (0xd3cb bytes) 2024-09-18T00:32:53.890 INFO:teuthology.orchestra.run.smithi081.stdout:5534 read 0xbe61399 thru 0xbe63ed5 (0x2b3d bytes) 2024-09-18T00:32:53.890 INFO:teuthology.orchestra.run.smithi081.stdout:5535 trunc from 0xddc957d to 0xda264ea 2024-09-18T00:32:53.902 INFO:teuthology.orchestra.run.smithi081.stdout:5536 write 0xacf1d8 thru 0xadd295 (0xe0be bytes) 2024-09-18T00:32:53.911 INFO:teuthology.orchestra.run.smithi081.stdout:5537 write 0x9b0cf11 thru 0x9b1baa9 (0xeb99 bytes) 2024-09-18T00:32:53.916 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:53.914+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:53.922 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.922 INFO:teuthology.orchestra.run.smithi081.stdout:5542 writesame 0x4a21cf1 thru 0x4a27b48 data_size 0x4(0x5e58 bytes) 2024-09-18T00:32:53.930 INFO:teuthology.orchestra.run.smithi081.stdout:5543 trunc from 0xda264ea to 0xbd6598a 2024-09-18T00:32:53.945 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:53.945 INFO:teuthology.orchestra.run.smithi081.stdout:5545 read 0x85d0825 thru 0x85d5a1c (0x51f8 bytes) 2024-09-18T00:32:53.945 INFO:teuthology.orchestra.run.smithi081.stdout:5546 punch from 0x563eb6d to 0x5649000, (0xa493 bytes) 2024-09-18T00:32:53.945 INFO:teuthology.orchestra.run.smithi081.stdout:5548 punch from 0x3b5b63c to 0x3b5d26a, (0x1c2e bytes) 2024-09-18T00:32:53.950 INFO:teuthology.orchestra.run.smithi081.stdout:5549 trunc from 0xbd6598a to 0x71eecfe 2024-09-18T00:32:53.969 INFO:teuthology.orchestra.run.smithi081.stdout:5550 read 0x230e3bf thru 0x231759a (0x91dc bytes) 2024-09-18T00:32:53.969 INFO:teuthology.orchestra.run.smithi081.stdout:5551 read 0x654022c thru 0x65445de (0x43b3 bytes) 2024-09-18T00:32:53.970 INFO:teuthology.orchestra.run.smithi081.stdout:5552 read 0x62845df thru 0x6292d48 (0xe76a bytes) 2024-09-18T00:32:53.975 INFO:teuthology.orchestra.run.smithi081.stdout:5553 trunc from 0x71eecfe to 0xa206a28 2024-09-18T00:32:53.991 INFO:teuthology.orchestra.run.smithi081.stdout:5556 writesame 0xde29478 thru 0xde31aba data_size 0x43(0x8643 bytes) 2024-09-18T00:32:53.991 INFO:teuthology.orchestra.run.smithi081.stdout:5557 writesame 0x47095cc thru 0x470d1dc data_size 0x1(0x3c11 bytes) 2024-09-18T00:32:54.002 INFO:teuthology.orchestra.run.smithi081.stdout:5558 punch from 0xc043f91 to 0xc04fe64, (0xbed3 bytes) 2024-09-18T00:32:54.003 INFO:teuthology.orchestra.run.smithi081.stdout:5559 write 0x9dc418f thru 0x9dd189b (0xd70d bytes) 2024-09-18T00:32:54.014 INFO:teuthology.orchestra.run.smithi081.stdout:5560 write 0x2b82442 thru 0x2b834be (0x107d bytes) 2024-09-18T00:32:54.016 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:54.014+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:54.016 INFO:teuthology.orchestra.run.smithi081.stdout:5563 read 0x2ee0843 thru 0x2ee61da (0x5998 bytes) 2024-09-18T00:32:54.017 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.048241511000001, 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.018 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:54.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:54.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:54.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.047861853999997, 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:54.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.047032670999997, 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:54.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:54.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.040248067999997, 2024-09-18T00:32:54.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.040227602000002, 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.040203513000002, 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.038357550999997, 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.038293732, 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.038264851999998, 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.038239875999999, 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.038220824, 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.036272027000003, 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.036249570000003, 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.036221130000001, 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.036198822000003, 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.036178370000002, 2024-09-18T00:32:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.035348921000001, 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.035307996, 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.035266749000002, 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.035244083999999, 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:54.110 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:54.111 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:54.112 INFO:teuthology.orchestra.run.smithi081.stdout:5564 trunc from 0xde31abb to 0x153cbab 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:5565 write 0x7afe607 thru 0x7b0da08 (0xf402 bytes) 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:5566 read 0x504077e thru 0x505039b (0xfc1e bytes) 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:5568 write 0x8ce024f thru 0x8cebf38 (0xbcea bytes) 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:5569 read 0x89ae2d6 thru 0x89b4418 (0x6143 bytes) 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:5571 punch from 0x811c286 to 0x811cb0d, (0x887 bytes) 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:5573 write 0x64b93d0 thru 0x64be9a4 (0x55d5 bytes) 2024-09-18T00:32:54.114 INFO:teuthology.orchestra.run.smithi081.stdout:5574 read 0x395236a thru 0x3952a28 (0x6bf bytes) 2024-09-18T00:32:54.117 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:54.116+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:54.122 INFO:teuthology.orchestra.run.smithi081.stdout:5575 trunc from 0x8cebf39 to 0x199f8c6 2024-09-18T00:32:54.135 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.135 INFO:teuthology.orchestra.run.smithi081.stdout:5578 read 0x206d46 thru 0x2125d2 (0xb88d bytes) 2024-09-18T00:32:54.152 INFO:teuthology.orchestra.run.smithi081.stdout:5579 write 0xa28ba92 thru 0xa29b2e7 (0xf856 bytes) 2024-09-18T00:32:54.164 INFO:teuthology.orchestra.run.smithi081.stdout:5580 read 0x3b367fe thru 0x3b3cc56 (0x6459 bytes) 2024-09-18T00:32:54.164 INFO:teuthology.orchestra.run.smithi081.stdout:5581 writesame 0x14cae4e thru 0x14cd1a1 data_size 0x26(0x2354 bytes) 2024-09-18T00:32:54.173 INFO:teuthology.orchestra.run.smithi081.stdout:5582 trunc from 0xa29b2e8 to 0x3e188fb 2024-09-18T00:32:54.188 INFO:teuthology.orchestra.run.smithi081.stdout:5583 read 0x3497a65 thru 0x34a4419 (0xc9b5 bytes) 2024-09-18T00:32:54.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:32:54.204 INFO:teuthology.orchestra.run.smithi081.stdout:5584 writesame 0xb4283d2 thru 0xb42bbb3 data_size 0x17(0x37e2 bytes) 2024-09-18T00:32:54.204 INFO:teuthology.orchestra.run.smithi081.stdout:5586 read 0x2ec865b thru 0x2ed137f (0x8d25 bytes) 2024-09-18T00:32:54.211 INFO:teuthology.orchestra.run.smithi081.stdout:5587 writesame 0xc97449c thru 0xc979422 data_size 0x1(0x4f87 bytes) 2024-09-18T00:32:54.211 INFO:teuthology.orchestra.run.smithi081.stdout:5590 read 0x65c1661 thru 0x65c9ad8 (0x8478 bytes) 2024-09-18T00:32:54.211 INFO:teuthology.orchestra.run.smithi081.stdout:5592 read 0xae72682 thru 0xae7976a (0x70e9 bytes) 2024-09-18T00:32:54.211 INFO:teuthology.orchestra.run.smithi081.stdout:5593 write 0x84c4266 thru 0x84cb740 (0x74db bytes) 2024-09-18T00:32:54.218 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:54.217+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:54.221 INFO:teuthology.orchestra.run.smithi081.stdout:5595 writesame 0x6da69de thru 0x6db1b5a data_size 0x1(0xb17d bytes) 2024-09-18T00:32:54.224 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:54.224 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:54.224 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:54.224 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:54.233 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:54.251 INFO:teuthology.orchestra.run.smithi081.stdout:5596 write 0x6e6c335 thru 0x6e7be58 (0xfb24 bytes) 2024-09-18T00:32:54.255 INFO:teuthology.orchestra.run.smithi081.stdout:5598 read 0xc820359 thru 0xc822ed2 (0x2b7a bytes) 2024-09-18T00:32:54.266 INFO:teuthology.orchestra.run.smithi081.stdout:5599 trunc from 0xc979423 to 0x41bbacf 2024-09-18T00:32:54.282 INFO:teuthology.orchestra.run.smithi081.stdout:5601 trunc from 0x41bbacf to 0x6fc709f 2024-09-18T00:32:54.288 INFO:teuthology.orchestra.run.smithi081.stdout:5602 write 0x2b6af24 thru 0x2b72c24 (0x7d01 bytes) 2024-09-18T00:32:54.295 INFO:teuthology.orchestra.run.smithi081.stdout:5603 write 0x6e6262b thru 0x6e6ef81 (0xc957 bytes) 2024-09-18T00:32:54.310 INFO:teuthology.orchestra.run.smithi081.stdout:5604 write 0x4ffa2b0 thru 0x4ffee71 (0x4bc2 bytes) 2024-09-18T00:32:54.319 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:54.318+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:54.326 INFO:teuthology.orchestra.run.smithi081.stdout:5605 writesame 0xabfc09c thru 0xabfc472 data_size 0x1(0x3d7 bytes) 2024-09-18T00:32:54.326 INFO:teuthology.orchestra.run.smithi081.stdout:5606 read 0x90594e9 thru 0x905c6b2 (0x31ca bytes) 2024-09-18T00:32:54.326 INFO:teuthology.orchestra.run.smithi081.stdout:5607 writesame 0x5720a26 thru 0x5727f7c data_size 0x33(0x7557 bytes) 2024-09-18T00:32:54.332 INFO:teuthology.orchestra.run.smithi081.stdout:5608 punch from 0x3812477 to 0x381bc2f, (0x97b8 bytes) 2024-09-18T00:32:54.332 INFO:teuthology.orchestra.run.smithi081.stdout:5609 read 0x10c1880 thru 0x10c56ae (0x3e2f bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5610 punch from 0x124b16 to 0x133a64, (0xef4e bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5612 punch from 0xa84831b to 0xa84ef33, (0x6c18 bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5613 punch from 0xb1a4ed to 0xb253d7, (0xaeea bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5614 read 0x35c6495 thru 0x35d39b1 (0xd51d bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5620 read 0x953ebd5 thru 0x9543744 (0x4b70 bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5621 read 0x7b0c7a7 thru 0x7b14369 (0x7bc3 bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5622 read 0x9548757 thru 0x95534b5 (0xad5f bytes) 2024-09-18T00:32:54.333 INFO:teuthology.orchestra.run.smithi081.stdout:5623 write 0x3277776 thru 0x3277b5a (0x3e5 bytes) 2024-09-18T00:32:54.336 INFO:teuthology.orchestra.run.smithi081.stdout:5624 read 0x7521619 thru 0x752b3ec (0x9dd4 bytes) 2024-09-18T00:32:54.336 INFO:teuthology.orchestra.run.smithi081.stdout:5625 write 0x32caf1f thru 0x32d3a76 (0x8b58 bytes) 2024-09-18T00:32:54.347 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:54.347 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:54.347 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:54.347 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:54.347 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:54.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:54.356 INFO:teuthology.orchestra.run.smithi081.stdout:5626 trunc from 0xabfc473 to 0x20b7b90 2024-09-18T00:32:54.373 INFO:teuthology.orchestra.run.smithi081.stdout:5628 read 0x81ddf4 thru 0x82ba88 (0xdc95 bytes) 2024-09-18T00:32:54.374 INFO:teuthology.orchestra.run.smithi081.stdout:5629 punch from 0x1452f5d to 0x1460336, (0xd3d9 bytes) 2024-09-18T00:32:54.391 INFO:teuthology.orchestra.run.smithi081.stdout:5630 write 0xadc66d1 thru 0xadca699 (0x3fc9 bytes) 2024-09-18T00:32:54.399 INFO:teuthology.orchestra.run.smithi081.stdout:5631 read 0xa79706 thru 0xa88650 (0xef4b bytes) 2024-09-18T00:32:54.400 INFO:teuthology.orchestra.run.smithi081.stdout:5633 read 0x145f39 thru 0x148a79 (0x2b41 bytes) 2024-09-18T00:32:54.400 INFO:teuthology.orchestra.run.smithi081.stdout:5634 read 0xd032ba thru 0xd09faf (0x6cf6 bytes) 2024-09-18T00:32:54.401 INFO:teuthology.orchestra.run.smithi081.stdout:5635 punch from 0xae52bd to 0xaeafc9, (0x5d0c bytes) 2024-09-18T00:32:54.404 INFO:teuthology.orchestra.run.smithi081.stdout:5636 trunc from 0xadca69a to 0xd446f66 2024-09-18T00:32:54.409 INFO:teuthology.orchestra.run.smithi081.stdout:5637 punch from 0x7d5c641 to 0x7d65328, (0x8ce7 bytes) 2024-09-18T00:32:54.409 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.409 INFO:teuthology.orchestra.run.smithi081.stdout:5640 write 0x789763a thru 0x78a5d13 (0xe6da bytes) 2024-09-18T00:32:54.420 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:54.419+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:54.426 INFO:teuthology.orchestra.run.smithi081.stdout:5641 trunc from 0xd446f66 to 0x715e5f5 2024-09-18T00:32:54.439 INFO:teuthology.orchestra.run.smithi081.stdout:5642 read 0x51fc339 thru 0x5200368 (0x4030 bytes) 2024-09-18T00:32:54.439 INFO:teuthology.orchestra.run.smithi081.stdout:5643 read 0x5a2dfb3 thru 0x5a38085 (0xa0d3 bytes) 2024-09-18T00:32:54.448 INFO:teuthology.orchestra.run.smithi081.stdout:5644 write 0x9eef9c4 thru 0x9ef808d (0x86ca bytes) 2024-09-18T00:32:54.456 INFO:teuthology.orchestra.run.smithi081.stdout:5645 punch from 0x236e369 to 0x237504d, (0x6ce4 bytes) 2024-09-18T00:32:54.456 INFO:teuthology.orchestra.run.smithi081.stdout:5646 writesame 0x3df3114 thru 0x3df9781 data_size 0x7(0x666e bytes) 2024-09-18T00:32:54.467 INFO:teuthology.orchestra.run.smithi081.stdout:5647 writesame 0x3f1f67 thru 0x3fa74e data_size 0x4(0x87e8 bytes) 2024-09-18T00:32:54.471 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:54.471 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324427972999999, 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.32440751, 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324388114999998, 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324368960000001, 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324349529999999, 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:54.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324329874999997, 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.496 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324310881000002, 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.500 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.504 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324271955999997, 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324251875999998, 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.509 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:54.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324232131999999, 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.513 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:54.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:54.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324212353, 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:54.521 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324192764999999, 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:54.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:54.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324163298999999, 2024-09-18T00:32:54.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.530 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324132966000001, 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:54.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324106235999999, 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.535 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.539 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324078839000002, 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:54.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324053196000001, 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.544 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:54.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:54.548 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.324028290000001, 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:54.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:54.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.323994118999998, 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.553 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:54.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 42.323956199000001, 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.557 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.561 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:54.563 INFO:teuthology.orchestra.run.smithi081.stdout:5648 punch from 0x355aabc to 0x35648d8, (0x9e1c bytes) 2024-09-18T00:32:54.563 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:54.563 INFO:teuthology.orchestra.run.smithi081.stdout:5650 trunc from 0x9ef808e to 0x2961118 2024-09-18T00:32:54.563 INFO:teuthology.orchestra.run.smithi081.stdout:5651 clone 44 order 25 su 524288 sc 5 2024-09-18T00:32:54.563 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:54.561+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:54.564 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:54.664 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:54.662+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:54.667 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:54.667 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:54.676 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:54.765 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:54.763+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:54.819 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:54.819 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:54.819 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:54.819 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:54.819 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:54.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:54.868 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:54.867+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:54.967 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:54.966+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.169838419000001, 2024-09-18T00:32:54.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:54.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:54.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.167907976000002, 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:54.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.167889635999998, 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.166298914999999, 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.987 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:54.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:54.991 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.166255681999999, 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.992 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:54.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:54.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.166057535, 2024-09-18T00:32:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:54.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.165903143000001, 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:55.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.165689397999998, 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:55.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.009 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.165491003, 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.165130155, 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.014 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:55.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:55.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.161849156999999, 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.018 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:55.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.161829982, 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:55.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.159970878000003, 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:55.027 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.031 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.159945981, 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.159925475999998, 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.040 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.159906722000002, 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:55.044 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.157886441000002, 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.045 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:55.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.157867854999999, 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:55.049 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:55.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.157031942000003, 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:55.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:55.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 62.151856776000002, 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:55.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:55.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:55.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:55.064 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:55.068 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:55.067+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:55.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:55.169 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:55.167+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:55.199 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:32:55.211 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:55.211 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:55.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:55.247 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:55.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:55.269 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:55.268+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:55.283 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:55.300 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:55.314 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-18T00:32:55.318 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:55.319 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:55.321 INFO:teuthology.orchestra.run.smithi081.stdout:5652 read 0x8e99f4 thru 0x8f47fb (0xae08 bytes) 2024-09-18T00:32:55.336 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:55.337 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:55.345 INFO:teuthology.orchestra.run.smithi081.stdout:5653 write 0xdfbf4f3 thru 0xdfc2435 (0x2f43 bytes) 2024-09-18T00:32:55.348 INFO:teuthology.orchestra.run.smithi081.stdout:5655 punch from 0xf2de66 to 0xf36a74, (0x8c0e bytes) 2024-09-18T00:32:55.349 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.352 INFO:teuthology.orchestra.run.smithi081.stdout:5658 trunc from 0xdfc2436 to 0xb2e784c 2024-09-18T00:32:55.354 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:55.359 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.367 INFO:teuthology.orchestra.run.smithi081.stdout:5660 writesame 0xe35dcd2 thru 0xe36ab4f data_size 0x1(0xce7e bytes) 2024-09-18T00:32:55.368 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.368 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.369 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:55.369 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:55.370 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:55.369+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:55.373 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:55.373 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:55.378 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:55.382 INFO:teuthology.orchestra.run.smithi081.stdout:5664 trunc from 0xe36ab50 to 0x1fddd97 2024-09-18T00:32:55.430 INFO:teuthology.orchestra.run.smithi081.stdout:5665 write 0x5bf4494 thru 0x5bf7210 (0x2d7d bytes) 2024-09-18T00:32:55.432 INFO:teuthology.orchestra.run.smithi081.stdout:5666 punch from 0x37093c8 to 0x3716bd3, (0xd80b bytes) 2024-09-18T00:32:55.432 INFO:teuthology.orchestra.run.smithi081.stdout:5667 punch from 0x1ab6559 to 0x1ac3aac, (0xd553 bytes) 2024-09-18T00:32:55.432 INFO:teuthology.orchestra.run.smithi081.stdout:5671 read 0x5a413e2 thru 0x5a487d8 (0x73f7 bytes) 2024-09-18T00:32:55.433 INFO:teuthology.orchestra.run.smithi081.stdout:5672 punch from 0x3070050 to 0x3078f87, (0x8f37 bytes) 2024-09-18T00:32:55.433 INFO:teuthology.orchestra.run.smithi081.stdout:5673 writesame 0x4769206 thru 0x476a145 data_size 0x10(0xf40 bytes) 2024-09-18T00:32:55.434 INFO:teuthology.orchestra.run.smithi081.stdout:5675 read 0x197ba3a thru 0x1984d53 (0x931a bytes) 2024-09-18T00:32:55.434 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.434 INFO:teuthology.orchestra.run.smithi081.stdout:5678 write 0x45e3515 thru 0x45e9c93 (0x677f bytes) 2024-09-18T00:32:55.436 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.436 INFO:teuthology.orchestra.run.smithi081.stdout:5680 punch from 0x4a81a56 to 0x4a86f87, (0x5531 bytes) 2024-09-18T00:32:55.440 INFO:teuthology.orchestra.run.smithi081.stdout:5681 trunc from 0x5bf7211 to 0x9150d11 2024-09-18T00:32:55.446 INFO:teuthology.orchestra.run.smithi081.stdout:5682 read 0x358a54b thru 0x358d2fd (0x2db3 bytes) 2024-09-18T00:32:55.446 INFO:teuthology.orchestra.run.smithi081.stdout:5683 read 0x8054f2a thru 0x805905a (0x4131 bytes) 2024-09-18T00:32:55.446 INFO:teuthology.orchestra.run.smithi081.stdout:5684 read 0x8bd14de thru 0x8bd4550 (0x3073 bytes) 2024-09-18T00:32:55.447 INFO:teuthology.orchestra.run.smithi081.stdout:5685 read 0x79cb3d thru 0x7ac075 (0xf539 bytes) 2024-09-18T00:32:55.448 INFO:teuthology.orchestra.run.smithi081.stdout:5686 punch from 0x332918b to 0x332d195, (0x400a bytes) 2024-09-18T00:32:55.448 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.448 INFO:teuthology.orchestra.run.smithi081.stdout:5688 read 0x1a40c36 thru 0x1a4f291 (0xe65c bytes) 2024-09-18T00:32:55.448 INFO:teuthology.orchestra.run.smithi081.stdout:5690 read 0x3f0fd9a thru 0x3f1ce0f (0xd076 bytes) 2024-09-18T00:32:55.449 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.449 INFO:teuthology.orchestra.run.smithi081.stdout:5692 read 0x72e11b6 thru 0x72e5737 (0x4582 bytes) 2024-09-18T00:32:55.449 INFO:teuthology.orchestra.run.smithi081.stdout:5693 punch from 0x610f09c to 0x611629a, (0x71fe bytes) 2024-09-18T00:32:55.449 INFO:teuthology.orchestra.run.smithi081.stdout:5697 write 0x574e6da thru 0x5754b53 (0x647a bytes) 2024-09-18T00:32:55.457 INFO:teuthology.orchestra.run.smithi081.stdout:5698 trunc from 0x9150d11 to 0x2e29170 2024-09-18T00:32:55.465 INFO:teuthology.orchestra.run.smithi081.stdout:5699 read 0x843385 thru 0x849fc4 (0x6c40 bytes) 2024-09-18T00:32:55.465 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.465 INFO:teuthology.orchestra.run.smithi081.stdout:5701 writesame 0xb545b8 thru 0xb590f0 data_size 0x31(0x4b39 bytes) 2024-09-18T00:32:55.471 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:55.470+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:55.476 INFO:teuthology.orchestra.run.smithi081.stdout:5702 write 0x5ee36d4 thru 0x5ef2fce (0xf8fb bytes) 2024-09-18T00:32:55.490 INFO:teuthology.orchestra.run.smithi081.stdout:5704 write 0xb2e34ea thru 0xb2e6047 (0x2b5e bytes) 2024-09-18T00:32:55.495 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:55.495 INFO:teuthology.orchestra.run.smithi081.stdout:5706 clone 45 order 19 su 32768 sc 13 2024-09-18T00:32:55.525 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:55.525 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:55.533 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:55.572 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:55.570+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:55.637 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:55.637 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:55.645 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:55.689 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:55.688+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:55.747 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:55.747 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:55.756 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:55.774 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:55.773+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:55.875 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:55.874+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:55.899 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:55.899 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:55.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:55.977 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:55.975+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:56.025 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.025 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:56.078 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:56.076+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:56.179 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.179 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.179 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:56.177+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:56.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone44 from 0xb2e6048 (overlap 0x1fddd97) to 0x131eb5a 2024-09-18T00:32:56.280 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:56.278+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:56.322 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-18T00:32:56.345 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.345 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:32:56.382 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.382 INFO:teuthology.orchestra.run.smithi081.stdout:5708 read 0x52480a8 thru 0x5256f88 (0xeee1 bytes) 2024-09-18T00:32:56.382 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:56.380+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:56.384 INFO:teuthology.orchestra.run.smithi081.stdout:5711 punch from 0x99f084e to 0x99f289d, (0x204f bytes) 2024-09-18T00:32:56.387 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.387 INFO:teuthology.orchestra.run.smithi081.stdout:5713 write 0x3b4fe3f thru 0x3b501b0 (0x372 bytes) 2024-09-18T00:32:56.393 INFO:teuthology.orchestra.run.smithi081.stdout:5716 writesame 0x5cd8f06 thru 0x5cdbf16 data_size 0x17(0x3011 bytes) 2024-09-18T00:32:56.397 INFO:teuthology.orchestra.run.smithi081.stdout:5717 write 0xa94e4df thru 0xa954640 (0x6162 bytes) 2024-09-18T00:32:56.404 INFO:teuthology.orchestra.run.smithi081.stdout:5718 punch from 0x9bd2d0f to 0x9bdb7ad, (0x8a9e bytes) 2024-09-18T00:32:56.404 INFO:teuthology.orchestra.run.smithi081.stdout:5719 punch from 0x7c0772c to 0x7c108c0, (0x9194 bytes) 2024-09-18T00:32:56.404 INFO:teuthology.orchestra.run.smithi081.stdout:5721 read 0x1d7d2e1 thru 0x1d7eaf4 (0x1814 bytes) 2024-09-18T00:32:56.404 INFO:teuthology.orchestra.run.smithi081.stdout:5722 read 0xa74cc4c thru 0xa758623 (0xb9d8 bytes) 2024-09-18T00:32:56.404 INFO:teuthology.orchestra.run.smithi081.stdout:5723 write 0x6864b44 thru 0x686f100 (0xa5bd bytes) 2024-09-18T00:32:56.421 INFO:teuthology.orchestra.run.smithi081.stdout:5724 trunc from 0xb2e6048 to 0x26b96a1 2024-09-18T00:32:56.446 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.446 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xed00a28 2024-09-18T00:32:56.463 INFO:teuthology.orchestra.run.smithi081.stdout:5726 trunc from 0x26b96a1 to 0xed00a28 2024-09-18T00:32:56.468 INFO:teuthology.orchestra.run.smithi081.stdout:5727 read 0xce0b43f thru 0xce1a7b9 (0xf37b bytes) 2024-09-18T00:32:56.468 INFO:teuthology.orchestra.run.smithi081.stdout:5728 writesame 0x6f4495d thru 0x6f46091 data_size 0x1(0x1735 bytes) 2024-09-18T00:32:56.474 INFO:teuthology.orchestra.run.smithi081.stdout:5729 write 0x40c5937 thru 0x40cd2f4 (0x79be bytes) 2024-09-18T00:32:56.479 INFO:teuthology.orchestra.run.smithi081.stdout:5730 read 0x661abc4 thru 0x6625067 (0xa4a4 bytes) 2024-09-18T00:32:56.479 INFO:teuthology.orchestra.run.smithi081.stdout:5731 read 0x2a963ee thru 0x2a99fd7 (0x3bea bytes) 2024-09-18T00:32:56.479 INFO:teuthology.orchestra.run.smithi081.stdout:5734 read 0xc1f9ca thru 0xc269da (0x7011 bytes) 2024-09-18T00:32:56.479 INFO:teuthology.orchestra.run.smithi081.stdout:5735 write 0xd953f01 thru 0xd954dc1 (0xec1 bytes) 2024-09-18T00:32:56.481 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:56.480+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:56.496 INFO:teuthology.orchestra.run.smithi081.stdout:5736 trunc from 0xed00a28 to 0x5d3ec91 2024-09-18T00:32:56.507 INFO:teuthology.orchestra.run.smithi081.stdout:5737 read 0x5148abe thru 0x5148e36 (0x379 bytes) 2024-09-18T00:32:56.507 INFO:teuthology.orchestra.run.smithi081.stdout:5738 read 0x29d6122 thru 0x29d97c6 (0x36a5 bytes) 2024-09-18T00:32:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:5739 read 0x5d3283f thru 0x5d35405 (0x2bc7 bytes) 2024-09-18T00:32:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:5740 punch from 0x2165592 to 0x2168040, (0x2aae bytes) 2024-09-18T00:32:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:5741 read 0x1e3f31d thru 0x1e454d6 (0x61ba bytes) 2024-09-18T00:32:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:5742 read 0x232f6e4 thru 0x233f247 (0xfb64 bytes) 2024-09-18T00:32:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:5743 punch from 0x2155dbd to 0x2159fd0, (0x4213 bytes) 2024-09-18T00:32:56.516 INFO:teuthology.orchestra.run.smithi081.stdout:5745 write 0x74cfb2e thru 0x74d11e8 (0x16bb bytes) 2024-09-18T00:32:56.517 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.518 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.525 INFO:teuthology.orchestra.run.smithi081.stdout:5746 write 0x822e647 thru 0x822f3ae (0xd68 bytes) 2024-09-18T00:32:56.528 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.528 INFO:teuthology.orchestra.run.smithi081.stdout:5748 read 0x2e9bd86 thru 0x2eab26d (0xf4e8 bytes) 2024-09-18T00:32:56.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:32:56.530 INFO:teuthology.orchestra.run.smithi081.stdout:5750 trunc from 0x822f3af to 0x7e158e0 2024-09-18T00:32:56.537 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.537 INFO:teuthology.orchestra.run.smithi081.stdout:5752 read 0x2d9b149 thru 0x2da0906 (0x57be bytes) 2024-09-18T00:32:56.543 INFO:teuthology.orchestra.run.smithi081.stdout:5753 write 0x8cbae1b thru 0x8cc699a (0xbb80 bytes) 2024-09-18T00:32:56.547 INFO:teuthology.orchestra.run.smithi081.stdout:5754 read 0x4e273b8 thru 0x4e2ae72 (0x3abb bytes) 2024-09-18T00:32:56.547 INFO:teuthology.orchestra.run.smithi081.stdout:5755 read 0x5ea6921 thru 0x5eb43f0 (0xdad0 bytes) 2024-09-18T00:32:56.547 INFO:teuthology.orchestra.run.smithi081.stdout:5756 writesame 0x45c11af thru 0x45cf972 data_size 0x1(0xe7c4 bytes) 2024-09-18T00:32:56.583 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:56.581+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:56.587 INFO:teuthology.orchestra.run.smithi081.stdout:5757 trunc from 0x8cc699b to 0x38f765b 2024-09-18T00:32:56.603 INFO:teuthology.orchestra.run.smithi081.stdout:5758 punch from 0x1f5e54d to 0x1f6ca7b, (0xe52e bytes) 2024-09-18T00:32:56.603 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.608 INFO:teuthology.orchestra.run.smithi081.stdout:5763 trunc from 0x38f765b to 0x7f087c1 2024-09-18T00:32:56.625 INFO:teuthology.orchestra.run.smithi081.stdout:5764 write 0xd17022f thru 0xd17c058 (0xbe2a bytes) 2024-09-18T00:32:56.631 INFO:teuthology.orchestra.run.smithi081.stdout:5765 writesame 0x2f4f222 thru 0x2f51fe9 data_size 0x14(0x2dc8 bytes) 2024-09-18T00:32:56.636 INFO:teuthology.orchestra.run.smithi081.stdout:5766 read 0xccf82cd thru 0xccfa5d5 (0x2309 bytes) 2024-09-18T00:32:56.637 INFO:teuthology.orchestra.run.smithi081.stdout:5768 read 0x682f334 thru 0x683c72e (0xd3fb bytes) 2024-09-18T00:32:56.637 INFO:teuthology.orchestra.run.smithi081.stdout:5769 write 0x601fa25 thru 0x602ef77 (0xf553 bytes) 2024-09-18T00:32:56.645 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:56.645 INFO:teuthology.orchestra.run.smithi081.stdout:5772 write 0x90e432e thru 0x90f1bc7 (0xd89a bytes) 2024-09-18T00:32:56.651 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.651 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.666 INFO:teuthology.orchestra.run.smithi081.stdout:5773 trunc from 0xd17c059 to 0x11ed03e 2024-09-18T00:32:56.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:32:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:5775 clone 46 order 23 su 4194304 sc 11 2024-09-18T00:32:56.708 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:56.706+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:56.784 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:56.782+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:32:56.885 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:56.884+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:56.960 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:56.961 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:56.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:32:57.012 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:57.011+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:57.073 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:57.073 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:57.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:32:57.087 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:57.086+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:57.189 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:57.187+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:57.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:32:57.229 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:57.229 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:57.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:32:57.289 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:57.288+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:57.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:32:57.391 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:57.389+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:57.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:32:57.481 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone45 from 0x11ed03e (overlap 0x11ed03e) to 0x8f681f 2024-09-18T00:32:57.492 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:57.491+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:57.538 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:57.559 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:57.559 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:57.589 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:57.591 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-18T00:32:57.599 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:57.600 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:57.600 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:57.598+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:57.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:32:57.610 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:57.629 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:57.630 INFO:teuthology.orchestra.run.smithi081.stdout:5776 read 0xdab776 thru 0xdaeec7 (0x3752 bytes) 2024-09-18T00:32:57.652 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:57.659 INFO:teuthology.orchestra.run.smithi081.stdout:5778 write 0xe3dd9de thru 0xe3de5fb (0xc1e bytes) 2024-09-18T00:32:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:5779 read 0x1101c7f thru 0x1103547 (0x18c9 bytes) 2024-09-18T00:32:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:57.671 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:5781 trunc from 0xe3de5fc to 0x5a370af 2024-09-18T00:32:57.689 INFO:teuthology.orchestra.run.smithi081.stdout:5783 trunc from 0x5a370af to 0x92e1464 2024-09-18T00:32:57.691 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:57.691 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:32:57.693 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:57.692+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:57.696 INFO:teuthology.orchestra.run.smithi081.stdout:5785 clone 47 order 21 su 524288 sc 5 2024-09-18T00:32:57.729 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:32:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:32:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:32:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.759621111000001, 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:32:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.759241453999998, 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:32:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.758412270999997, 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.743 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.751627667999998, 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:32:57.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.751607202000002, 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.752 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.751583113000002, 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.749737150999998, 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:32:57.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.749673332, 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.765 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.749644451999998, 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:32:57.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.749619475999999, 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:32:57.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:32:57.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.749600424, 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:32:57.774 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:32:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:32:57.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.747651627000003, 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:32:57.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.747629170000003, 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.747600730000002, 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:32:57.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:32:57.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.747578421999997, 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:32:57.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:32:57.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:32:57.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:32:57.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:32:57.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:32:57.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:57.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.747557970000003, 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:57.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:32:57.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:32:57.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.746728521000001, 2024-09-18T00:32:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.746687596000001, 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:32:57.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.746646349000002, 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:32:57.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:32:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.746623683999999, 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:57.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:32:57.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:32:57.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:32:57.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:32:57.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:32:57.824 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:57.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:32:57.826 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:57.824+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:57.926 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:57.925+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:57.930 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:57.930 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:57.930 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:57.930 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:57.939 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:32:58.028 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:58.026+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:58.041 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:58.041 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:58.041 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.049 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:32:58.129 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:58.127+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006891074999999, 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.154 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:32:58.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:32:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:32:58.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006870612, 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.160 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006851216999998, 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.164 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:32:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006832062000001, 2024-09-18T00:32:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:32:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006812631999999, 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006792977000003, 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:32:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:32:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006773983000002, 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006735057999997, 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:32:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:32:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006714977999998, 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:32:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006695233999999, 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:32:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:32:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:32:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006675455, 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:32:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:32:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006655866999999, 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:32:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006626400999998, 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:32:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:32:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006596068, 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006569337999998, 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006541941000002, 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:32:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:32:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006516298000001, 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:32:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:32:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006491392000001, 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:32:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:32:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006457220999998, 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:32:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:32:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 46.006419301000001, 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:32:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.249 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.251 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:32:58.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:32:58.252 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:32:58.249+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:32:58.297 INFO:teuthology.orchestra.run.smithi081.stdout:leaving image image_client.0-clone46 intact 2024-09-18T00:32:58.352 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:58.350+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:58.356 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.356 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:58.356 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:58.356 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.365 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:32:58.431 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #45, image image_client.0-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent46 2024-09-18T00:32:58.452 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:58.451+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:5787 write 0xde09397 thru 0xde15ef3 (0xcb5d bytes) 2024-09-18T00:32:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:5788 read 0x2124e28 thru 0x212f517 (0xa6f0 bytes) 2024-09-18T00:32:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:5789 read 0x24f7d72 thru 0x24f8f0d (0x119c bytes) 2024-09-18T00:32:58.475 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.475 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:58.475 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:58.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:58.475 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.480 INFO:teuthology.orchestra.run.smithi081.stdout:5793 write 0xea4d316 thru 0xea54bb2 (0x789d bytes) 2024-09-18T00:32:58.484 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:32:58.484 INFO:teuthology.orchestra.run.smithi081.stdout:5795 write 0xea3c768 thru 0xea40de7 (0x4680 bytes) 2024-09-18T00:32:58.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:32:58.486 INFO:teuthology.orchestra.run.smithi081.stdout:5796 clone 48 order 25 su 8388608 sc 5 2024-09-18T00:32:58.553 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:58.552+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.827275374999999, 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.631 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:32:58.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.825344931999993, 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:32:58.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.640 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.825326591999996, 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:32:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.823735870999997, 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.645 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:32:58.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.649 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.823692637999997, 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:32:58.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.823494491000005, 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.658 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.823340099000006, 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:32:58.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:32:58.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.663 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.823126353999996, 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.822927958999998, 2024-09-18T00:32:58.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:32:58.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.673 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.822567110999998, 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.678 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.819286113000004, 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:32:58.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:32:58.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.819266937999998, 2024-09-18T00:32:58.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.817407833999994, 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:32:58.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.817382937000005, 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:32:58.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.697 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.817362431999996, 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:32:58.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:58.702 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.817343678, 2024-09-18T00:32:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:32:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.703 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:32:58.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:58.708 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.815323397, 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:32:58.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.815304811000004, 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:32:58.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.814468898000001, 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.718 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.722 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 65.809293732, 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:58.723 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:58.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:58.727 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:32:58.729 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:58.727+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:58.733 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:32:58.734 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:32:58.734 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:32:58.734 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.094329 2024-09-18T00:32:58.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.09432882458633152 2024-09-18T00:32:58.830 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:58.828+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:58.832 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.832 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:58.832 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:58.832 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:32:58.931 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:58.930+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:58.944 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:58.944 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:58.944 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:58.944 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:58.945 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:58.953 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:32:59.032 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:59.031+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:59.097 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:59.097 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.737220671000003, 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.098 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:32:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.731872134, 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:32:59.102 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:32:59.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:32:59.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.728132408999997, 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:32:59.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:32:59.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.110 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.728108040999999, 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:32:59.114 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.728095460999995, 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:32:59.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:32:59.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.728085184999998, 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.119 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:32:59.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.716231000999997, 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:32:59.123 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:32:59.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:32:59.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.716210630999996, 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:32:59.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:32:59.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:32:59.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.714250993999997, 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:32:59.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.714241724999994, 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:32:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.140 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.712228424000003, 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:32:59.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.712210263000003, 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.709912380000006, 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.149 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:32:59.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:32:59.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.709871930000006, 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.153 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:32:59.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:32:59.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:32:59.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.709776434000005, 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:32:59.157 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:32:59.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.708200708999996, 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:32:59.161 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:59.165 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.708179990999994, 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.169 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.708156458000005, 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:32:59.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.173 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.708133860000004, 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.174 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:32:59.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:32:59.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:32:59.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 66.706178303000002, 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:32:59.178 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:32:59.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:32:59.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:32:59.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.184 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.184 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:59.185 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:32:59.186 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:32:59.184+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:32:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.6 primary-affinity to 0.0943288 (861812) 2024-09-18T00:32:59.286 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:32:59.285+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:32:59.330 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:59.330 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:32:59.330 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:59.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:32:59.422 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:32:59.421+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:32:59.482 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:59.482 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:32:59.482 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:32:59.482 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:32:59.482 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:59.488 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:32:59.487+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:32:59.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:32:59.589 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:59.588+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0472060929999998, 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.637 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0471409079999994, 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.642 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:32:59.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.646 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0470239980000002, 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.647 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:32:59.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0453131869999996, 2024-09-18T00:32:59.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:32:59.655 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0431656359999995, 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.656 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:32:59.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0413815839999998, 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:32:59.660 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:32:59.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0413455480000007, 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:32:59.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:32:59.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0413353539999992, 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:32:59.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:32:59.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:32:59.673 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0413255100000001, 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:32:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.677 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0392130739999992, 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.678 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0391193049999998, 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.682 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:32:59.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0390986160000004, 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.687 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0390798310000005, 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.691 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:32:59.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:32:59.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0390057610000003, 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:32:59.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:32:59.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0389863080000001, 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.700 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:32:59.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0389669440000002, 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.705 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:32:59.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:32:59.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0387928950000003, 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.714 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0387625299999996, 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:32:59.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0373156629999993, 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:32:59.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 9.0372902039999996, 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:32:59.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:32:59.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:32:59.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:32:59.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:32:59.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.728 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:32:59.728 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:32:59.728 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:32:59.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:32:59.730 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:32:59.728+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:32:59.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:32:59.830 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:32:59.829+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:32:59.841 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:32:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:32:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:32:59.841 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:32:59.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:32:59.857 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:32:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:32:59.874 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:32:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:32:59.890 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:32:59.891 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:32:59.907 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:32:59.907 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:32:59.923 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:32:59.923 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:32:59.931 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:32:59.930+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:32:59.941 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:32:59.941 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:32:59.958 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:32:59.961 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:32:59.961 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:32:59.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:32:59.974 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:32:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:00.032 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:00.031+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:00.077 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:00.078 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:00.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:00.133 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:00.132+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:00.234 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:00.232+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:00.234 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:00.234 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:00.241 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone47 from 0xea54bb3 (overlap 0x92e1464) to 0x7581050 2024-09-18T00:33:00.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:00.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:33:00.335 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:00.333+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:00.400 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:00.400 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:00.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:00.417 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #46, image image_client.0-clone46 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent47 2024-09-18T00:33:00.436 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:00.435+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:00.537 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:00.535+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:00.541 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:00.541 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:00.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:00.618 INFO:teuthology.orchestra.run.smithi081.stdout:5797 read 0xac13224 thru 0xac1b727 (0x8504 bytes) 2024-09-18T00:33:00.619 INFO:teuthology.orchestra.run.smithi081.stdout:5798 read 0xab08905 thru 0xab0f004 (0x6700 bytes) 2024-09-18T00:33:00.620 INFO:teuthology.orchestra.run.smithi081.stdout:5800 write 0xdfb4eb0 thru 0xdfb5755 (0x8a6 bytes) 2024-09-18T00:33:00.635 INFO:teuthology.orchestra.run.smithi081.stdout:5801 trunc from 0xea54bb3 to 0x89c2308 2024-09-18T00:33:00.637 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:00.636+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:00.711 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:00.712 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:00.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:00.754 INFO:teuthology.orchestra.run.smithi081.stdout:5803 writesame 0xb0bc7fa thru 0xb0be126 data_size 0x1(0x192d bytes) 2024-09-18T00:33:00.755 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:00.753+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:00.762 INFO:teuthology.orchestra.run.smithi081.stdout:5805 write 0xc6e95e9 thru 0xc6f30a0 (0x9ab8 bytes) 2024-09-18T00:33:00.766 INFO:teuthology.orchestra.run.smithi081.stdout:5807 trunc from 0xc6f30a1 to 0xb4f7827 2024-09-18T00:33:00.788 INFO:teuthology.orchestra.run.smithi081.stdout:5808 trunc from 0xb4f7827 to 0x1728f78 2024-09-18T00:33:00.839 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:00.838+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:00.843 INFO:teuthology.orchestra.run.smithi081.stdout:5809 read 0x68e982 thru 0x695a51 (0x70d0 bytes) 2024-09-18T00:33:00.850 INFO:teuthology.orchestra.run.smithi081.stdout:5811 write 0x2753aca thru 0x27600ec (0xc623 bytes) 2024-09-18T00:33:00.866 INFO:teuthology.orchestra.run.smithi081.stdout:5812 write 0x79e4a5c thru 0x79e8044 (0x35e9 bytes) 2024-09-18T00:33:00.867 INFO:teuthology.orchestra.run.smithi081.stdout:5813 read 0x1f316b8 thru 0x1f3a61f (0x8f68 bytes) 2024-09-18T00:33:00.880 INFO:teuthology.orchestra.run.smithi081.stdout:5815 write 0xd08c668 thru 0xd09bb82 (0xf51b bytes) 2024-09-18T00:33:00.883 INFO:teuthology.orchestra.run.smithi081.stdout:5816 read 0x7aba7c9 thru 0x7ac3c2e (0x9466 bytes) 2024-09-18T00:33:00.883 INFO:teuthology.orchestra.run.smithi081.stdout:5817 writesame 0x122caff thru 0x122d951 data_size 0x1(0xe53 bytes) 2024-09-18T00:33:00.884 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:00.884 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:00.887 INFO:teuthology.orchestra.run.smithi081.stdout:5818 write 0x424c3e4 thru 0x4254ab7 (0x86d4 bytes) 2024-09-18T00:33:00.890 INFO:teuthology.orchestra.run.smithi081.stdout:5821 read 0x68bea5c thru 0x68cd0db (0xe680 bytes) 2024-09-18T00:33:00.890 INFO:teuthology.orchestra.run.smithi081.stdout:5822 write 0x9ea6990 thru 0x9ea8b5d (0x21ce bytes) 2024-09-18T00:33:00.892 INFO:teuthology.orchestra.run.smithi081.stdout:5824 write 0xde4303 thru 0xdec201 (0x7eff bytes) 2024-09-18T00:33:00.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:00.905 INFO:teuthology.orchestra.run.smithi081.stdout:5825 trunc from 0xd09bb83 to 0x42ba79d 2024-09-18T00:33:00.934 INFO:teuthology.orchestra.run.smithi081.stdout:5826 trunc from 0x42ba79d to 0xdba756f 2024-09-18T00:33:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:5828 read 0x8dd0eff thru 0x8dd426c (0x336e bytes) 2024-09-18T00:33:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:5829 writesame 0xc286911 thru 0xc28c776 data_size 0x2b(0x5e66 bytes) 2024-09-18T00:33:00.940 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:00.938+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:00.948 INFO:teuthology.orchestra.run.smithi081.stdout:5830 trunc from 0xdba756f to 0x9d72893 2024-09-18T00:33:00.958 INFO:teuthology.orchestra.run.smithi081.stdout:5832 punch from 0x28c47d5 to 0x28d3b30, (0xf35b bytes) 2024-09-18T00:33:00.958 INFO:teuthology.orchestra.run.smithi081.stdout:5833 write 0x304a81b thru 0x30500a4 (0x588a bytes) 2024-09-18T00:33:00.966 INFO:teuthology.orchestra.run.smithi081.stdout:5834 write 0xa407b05 thru 0xa412f6b (0xb467 bytes) 2024-09-18T00:33:00.970 INFO:teuthology.orchestra.run.smithi081.stdout:5835 punch from 0x6b1355e to 0x6b1ba6d, (0x850f bytes) 2024-09-18T00:33:00.970 INFO:teuthology.orchestra.run.smithi081.stdout:5836 read 0x9c3f477 thru 0x9c48f2c (0x9ab6 bytes) 2024-09-18T00:33:00.970 INFO:teuthology.orchestra.run.smithi081.stdout:5837 punch from 0x4e04892 to 0x4e049fe, (0x16c bytes) 2024-09-18T00:33:00.970 INFO:teuthology.orchestra.run.smithi081.stdout:5838 read 0x7e0d341 thru 0x7e1038c (0x304c bytes) 2024-09-18T00:33:00.971 INFO:teuthology.orchestra.run.smithi081.stdout:5839 read 0x7129c25 thru 0x712f58d (0x5969 bytes) 2024-09-18T00:33:00.971 INFO:teuthology.orchestra.run.smithi081.stdout:5842 read 0x610bcd2 thru 0x6113b6c (0x7e9b bytes) 2024-09-18T00:33:00.971 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:00.981 INFO:teuthology.orchestra.run.smithi081.stdout:5846 trunc from 0xa412f6c to 0x208d011 2024-09-18T00:33:00.998 INFO:teuthology.orchestra.run.smithi081.stdout:5847 punch from 0x95c089 to 0x95edd3, (0x2d4a bytes) 2024-09-18T00:33:00.998 INFO:teuthology.orchestra.run.smithi081.stdout:5848 read 0x7d9787 thru 0x7e035d (0x6bd7 bytes) 2024-09-18T00:33:00.999 INFO:teuthology.orchestra.run.smithi081.stdout:5849 read 0x5e36e6 thru 0x5ecf91 (0x98ac bytes) 2024-09-18T00:33:01.013 INFO:teuthology.orchestra.run.smithi081.stdout:5850 trunc from 0x208d011 to 0xd9a2ae1 2024-09-18T00:33:01.020 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.020 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.030 INFO:teuthology.orchestra.run.smithi081.stdout:5851 trunc from 0xd9a2ae1 to 0x66c3934 2024-09-18T00:33:01.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:01.042 INFO:teuthology.orchestra.run.smithi081.stdout:5852 punch from 0x31bb0fa to 0x31caa7b, (0xf981 bytes) 2024-09-18T00:33:01.042 INFO:teuthology.orchestra.run.smithi081.stdout:5853 write 0x5b8a9a7 thru 0x5b8f200 (0x485a bytes) 2024-09-18T00:33:01.043 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:01.041+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:01.044 INFO:teuthology.orchestra.run.smithi081.stdout:5856 read 0x438c9c thru 0x43d6b9 (0x4a1e bytes) 2024-09-18T00:33:01.045 INFO:teuthology.orchestra.run.smithi081.stdout:5857 write 0x500d838 thru 0x5019832 (0xbffb bytes) 2024-09-18T00:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:5860 punch from 0x4540f70 to 0x45459c3, (0x4a53 bytes) 2024-09-18T00:33:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:5861 write 0x5b16ae4 thru 0x5b1b601 (0x4b1e bytes) 2024-09-18T00:33:01.061 INFO:teuthology.orchestra.run.smithi081.stdout:5863 write 0xcd8de7a thru 0xcd90653 (0x27da bytes) 2024-09-18T00:33:01.064 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.064 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.074 INFO:teuthology.orchestra.run.smithi081.stdout:5866 trunc from 0xcd90654 to 0x477db7c 2024-09-18T00:33:01.104 INFO:teuthology.orchestra.run.smithi081.stdout:5867 write 0xed5390a thru 0xed55334 (0x1a2b bytes) 2024-09-18T00:33:01.107 INFO:teuthology.orchestra.run.smithi081.stdout:5868 punch from 0xb931494 to 0xb9354b4, (0x4020 bytes) 2024-09-18T00:33:01.107 INFO:teuthology.orchestra.run.smithi081.stdout:5869 punch from 0x1bc6565 to 0x1bcdec4, (0x795f bytes) 2024-09-18T00:33:01.107 INFO:teuthology.orchestra.run.smithi081.stdout:5871 read 0x73ee4e thru 0x73ff09 (0x10bc bytes) 2024-09-18T00:33:01.108 INFO:teuthology.orchestra.run.smithi081.stdout:5872 punch from 0x527b8ad to 0x5285d0f, (0xa462 bytes) 2024-09-18T00:33:01.108 INFO:teuthology.orchestra.run.smithi081.stdout:5873 write 0x68256 thru 0x71d78 (0x9b23 bytes) 2024-09-18T00:33:01.109 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.109 INFO:teuthology.orchestra.run.smithi081.stdout:5875 write 0xb452d95 thru 0xb4563cc (0x3638 bytes) 2024-09-18T00:33:01.113 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.113 INFO:teuthology.orchestra.run.smithi081.stdout:5877 writesame 0xa62441e thru 0xa62ddf4 data_size 0x1(0x99d7 bytes) 2024-09-18T00:33:01.133 INFO:teuthology.orchestra.run.smithi081.stdout:5878 read 0x1f82a41 thru 0x1f82d64 (0x324 bytes) 2024-09-18T00:33:01.134 INFO:teuthology.orchestra.run.smithi081.stdout:5879 write 0x4c8ab96 thru 0x4c9141c (0x6887 bytes) 2024-09-18T00:33:01.137 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.137 INFO:teuthology.orchestra.run.smithi081.stdout:5881 writesame 0x25ebed4 thru 0x25f8d81 data_size 0x8f(0xceae bytes) 2024-09-18T00:33:01.140 INFO:teuthology.orchestra.run.smithi081.stdout:5882 read 0xb5dba11 thru 0xb5e5498 (0x9a88 bytes) 2024-09-18T00:33:01.140 INFO:teuthology.orchestra.run.smithi081.stdout:5883 write 0xa0391f4 thru 0xa03cddd (0x3bea bytes) 2024-09-18T00:33:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:5884 write 0x1710920 thru 0x17171a9 (0x688a bytes) 2024-09-18T00:33:01.142 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:01.141+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:01.143 INFO:teuthology.orchestra.run.smithi081.stdout:5885 read 0xd4996 thru 0xd9deb (0x5456 bytes) 2024-09-18T00:33:01.159 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.159 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.160 INFO:teuthology.orchestra.run.smithi081.stdout:5886 trunc from 0xed55335 to 0x15de358 2024-09-18T00:33:01.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:01.184 INFO:teuthology.orchestra.run.smithi081.stdout:5887 punch from 0x119141e to 0x1195d95, (0x4977 bytes) 2024-09-18T00:33:01.184 INFO:teuthology.orchestra.run.smithi081.stdout:5889 read 0xf7fad1 thru 0xf8c9d8 (0xcf08 bytes) 2024-09-18T00:33:01.185 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.185 INFO:teuthology.orchestra.run.smithi081.stdout:5894 punch from 0x1655a6 to 0x1686a3, (0x30fd bytes) 2024-09-18T00:33:01.185 INFO:teuthology.orchestra.run.smithi081.stdout:5896 read 0x11ac803 thru 0x11ba250 (0xda4e bytes) 2024-09-18T00:33:01.194 INFO:teuthology.orchestra.run.smithi081.stdout:5897 write 0x3d18cba thru 0x3d1b89b (0x2be2 bytes) 2024-09-18T00:33:01.196 INFO:teuthology.orchestra.run.smithi081.stdout:5898 write 0x2b75636 thru 0x2b848dc (0xf2a7 bytes) 2024-09-18T00:33:01.207 INFO:teuthology.orchestra.run.smithi081.stdout:5900 write 0x620cbca thru 0x6215d0f (0x9146 bytes) 2024-09-18T00:33:01.208 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:5904 write 0xbfe2f37 thru 0xbfe49b7 (0x1a81 bytes) 2024-09-18T00:33:01.234 INFO:teuthology.orchestra.run.smithi081.stdout:5905 writesame 0xdd6ebc8 thru 0xdd71ecc data_size 0x1(0x3305 bytes) 2024-09-18T00:33:01.234 INFO:teuthology.orchestra.run.smithi081.stdout:5906 write 0xb3fd3ad thru 0xb404edd (0x7b31 bytes) 2024-09-18T00:33:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:33:01.243 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:01.241+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:01.251 INFO:teuthology.orchestra.run.smithi081.stdout:5907 trunc from 0xdd71ecd to 0x9191fc5 2024-09-18T00:33:01.272 INFO:teuthology.orchestra.run.smithi081.stdout:5910 write 0xc176d72 thru 0xc185b55 (0xede4 bytes) 2024-09-18T00:33:01.275 INFO:teuthology.orchestra.run.smithi081.stdout:5911 writesame 0x29a8cd8 thru 0x29b400f data_size 0x7c(0xb338 bytes) 2024-09-18T00:33:01.277 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:01.277 INFO:teuthology.orchestra.run.smithi081.stdout:5914 read 0x906aa7a thru 0x906d160 (0x26e7 bytes) 2024-09-18T00:33:01.285 INFO:teuthology.orchestra.run.smithi081.stdout:5915 write 0xd5e4e49 thru 0xd5eebdb (0x9d93 bytes) 2024-09-18T00:33:01.288 INFO:teuthology.orchestra.run.smithi081.stdout:5917 read 0x7dc0c85 thru 0x7dcf100 (0xe47c bytes) 2024-09-18T00:33:01.301 INFO:teuthology.orchestra.run.smithi081.stdout:5918 trunc from 0xd5eebdc to 0x2330a06 2024-09-18T00:33:01.305 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.305 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:01.322 INFO:teuthology.orchestra.run.smithi081.stdout:5919 write 0x4003d4d thru 0x40089c2 (0x4c76 bytes) 2024-09-18T00:33:01.326 INFO:teuthology.orchestra.run.smithi081.stdout:5920 read 0x1038ea1 thru 0x104416d (0xb2cd bytes) 2024-09-18T00:33:01.327 INFO:teuthology.orchestra.run.smithi081.stdout:5922 read 0x3e1a66e thru 0x3e223cf (0x7d62 bytes) 2024-09-18T00:33:01.327 INFO:teuthology.orchestra.run.smithi081.stdout:5924 read 0x2fac08f thru 0x2fb7e5f (0xbdd1 bytes) 2024-09-18T00:33:01.327 INFO:teuthology.orchestra.run.smithi081.stdout:5925 clone 49 order 24 su 131072 sc 10 2024-09-18T00:33:01.343 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:01.342+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:01.425 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.425 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.434 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:01.477 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:01.476+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:01.538 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.538 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.545 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:01.544+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:01.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:01.646 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:01.645+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:01.689 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.690 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:01.782 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:01.781+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:01.842 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.842 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:01.847 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:01.846+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:01.851 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:01.948 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:01.947+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:01.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:01.995 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:01.995 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:02.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:02.088 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:02.087+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:02.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:02.119 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:02.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:02.136 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:02.148 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:02.148 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:02.150 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:02.149+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:02.151 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:02.152 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:02.157 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:02.167 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:02.184 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:02.201 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:02.218 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:02.218 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:02.234 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:02.234 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:02.251 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:02.250+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:02.307 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:02.307 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.504010523000005, 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.308 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.309 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:33:02.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.502080079999999, 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.502061740000002, 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:02.318 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:33:02.319 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.321 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.500471019000003, 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.322 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.323 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.324 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:33:02.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.500427786000003, 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:33:02.326 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.327 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:33:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:33:02.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.500229638999997, 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:02.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:02.335 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.500075246999998, 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:02.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:33:02.339 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.499861502000002, 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:33:02.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:33:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.499663107000003, 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.499302259000004, 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:33:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:33:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:33:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.496021260999996, 2024-09-18T00:33:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.496002086000004, 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.494142982, 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:33:02.366 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.494118084999997, 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.367 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:33:02.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:33:02.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.494097580000002, 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:33:02.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:33:02.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:33:02.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.494078826000006, 2024-09-18T00:33:02.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:33:02.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.380 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.492058545000006, 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.381 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:33:02.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.385 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.492039958999996, 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:33:02.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:33:02.389 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.491204046000007, 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:33:02.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:33:02.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 69.486028880000006, 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:33:02.394 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:33:02.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:33:02.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.398 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.399 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:02.399 INFO:teuthology.orchestra.run.smithi081.stdout:truncating image image_client.0-clone48 from 0x40089c3 (overlap 0x15de358) to 0x0 2024-09-18T00:33:02.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:02.401 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:02.398+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:02.433 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #47, image image_client.0-clone47 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent48 2024-09-18T00:33:02.501 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:02.499+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:02.553 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:02.554 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:02.562 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:02.596 INFO:teuthology.orchestra.run.smithi081.stdout:5926 clone 50 order 19 su 16384 sc 5 2024-09-18T00:33:02.602 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:02.601+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:02.703 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:02.702+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:02.709 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:02.709 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:02.709 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:02.709 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:02.709 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:02.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:02.805 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:02.803+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.462850607000007, 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:02.823 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:02.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:02.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.457502070000004, 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:33:02.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:33:02.831 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.832 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.453762345000001, 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:02.833 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.834 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.835 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.836 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.453737977000003, 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.837 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:02.838 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:02.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:02.840 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.453725396999999, 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:02.841 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.842 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.843 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:02.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.845 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.453715121000002, 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.846 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.847 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.848 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.441860937000001, 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:02.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:02.851 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.852 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.853 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:02.854 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.441840567, 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:02.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.439880930000001, 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.863 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.439871660999998, 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.864 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:02.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.437858360000007, 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.868 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:02.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.437840198999993, 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.872 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.435542315999996, 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.876 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.435501865999996, 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.435406369999995, 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.433830645, 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.433809926999999, 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.895 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:02.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.898 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.898 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:02.898 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.433786393999995, 2024-09-18T00:33:02.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:02.898 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.898 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:02.899 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:02.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:02.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.433763795999994, 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.906 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.431808239000006, 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.907 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:02.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:02.912 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:02.914 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:02.915 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:02.912+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:03.014 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:03.013+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:03.060 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:03.060 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:03.060 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:03.060 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:03.069 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:03.115 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:03.114+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:03.211 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:03.211 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:03.211 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:03.211 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:03.211 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:03.215 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:03.214+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:03.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:03.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:33:03.316 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:03.315+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:03.327 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:03.327 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:03.327 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:03.327 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.73803259, 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:03.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:03.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.737967404999999, 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:03.332 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:03.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.737850495, 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:03.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.736139683999999, 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:03.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:03.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:03.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.352 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.733992132999999, 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.353 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:03.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:03.359 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.732208081, 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.360 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:03.364 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.732172045, 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.365 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:03.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.369 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.732161851000001, 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.373 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.732152007, 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.374 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.730039571000001, 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.379 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:03.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:03.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729945802, 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:03.383 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.387 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729925113, 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729906328, 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.392 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:03.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729832258, 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:03.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:03.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:03.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729812805, 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.401 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.405 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729793441, 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:03.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:03.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729619392, 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.410 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:03.414 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.729589026999999, 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:03.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:03.418 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.728142160000001, 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.419 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:03.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:03.423 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 12.728116700999999, 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:03.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:03.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:03.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:03.428 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:03.430 INFO:teuthology.orchestra.run.smithi081.stdout:leaving image image_client.0-clone49 intact 2024-09-18T00:33:03.431 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:03.428+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:03.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #48, image image_client.0-clone48 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent49 2024-09-18T00:33:03.459 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.459 INFO:teuthology.orchestra.run.smithi081.stdout:5931 read 0x398464b thru 0x3984d6b (0x721 bytes) 2024-09-18T00:33:03.460 INFO:teuthology.orchestra.run.smithi081.stdout:5932 write 0x2c758d8 thru 0x2c8579e (0xfec7 bytes) 2024-09-18T00:33:03.494 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.494 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.509 INFO:teuthology.orchestra.run.smithi081.stdout:5936 writesame 0x9f31a7c thru 0x9f31e29 data_size 0x3(0x3ae bytes) 2024-09-18T00:33:03.509 INFO:teuthology.orchestra.run.smithi081.stdout:5937 punch from 0x71390b9 to 0x71473a2, (0xe2e9 bytes) 2024-09-18T00:33:03.515 INFO:teuthology.orchestra.run.smithi081.stdout:5938 trunc from 0x9f31e2a to 0x28e28d3 2024-09-18T00:33:03.530 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:03.529+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:03.565 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:03.566 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:03.566 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:03.566 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:03.567 INFO:teuthology.orchestra.run.smithi081.stdout:5939 writesame 0x922014f thru 0x92288c3 data_size 0x3(0x8775 bytes) 2024-09-18T00:33:03.567 INFO:teuthology.orchestra.run.smithi081.stdout:5940 punch from 0x55d4cc to 0x563ad5, (0x6609 bytes) 2024-09-18T00:33:03.572 INFO:teuthology.orchestra.run.smithi081.stdout:5942 trunc from 0x92288c4 to 0xcf3d171 2024-09-18T00:33:03.578 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.578 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.578 INFO:teuthology.orchestra.run.smithi081.stdout:5945 punch from 0xc0cb7ce to 0xc0d0ed9, (0x570b bytes) 2024-09-18T00:33:03.579 INFO:teuthology.orchestra.run.smithi081.stdout:5946 read 0x148f3ed thru 0x1496f0a (0x7b1e bytes) 2024-09-18T00:33:03.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:03.586 INFO:teuthology.orchestra.run.smithi081.stdout:5947 write 0xe5cb681 thru 0xe5d9093 (0xda13 bytes) 2024-09-18T00:33:03.596 INFO:teuthology.orchestra.run.smithi081.stdout:5948 writesame 0x351930a thru 0x3521f87 data_size 0xe(0x8c7e bytes) 2024-09-18T00:33:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:5949 writesame 0x898733a thru 0x898a44c data_size 0x1(0x3113 bytes) 2024-09-18T00:33:03.615 INFO:teuthology.orchestra.run.smithi081.stdout:5950 writesame 0x1a572a thru 0x1ac5da data_size 0x1(0x6eb1 bytes) 2024-09-18T00:33:03.632 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:03.630+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:03.650 INFO:teuthology.orchestra.run.smithi081.stdout:5952 write 0x61bb6c4 thru 0x61c64d4 (0xae11 bytes) 2024-09-18T00:33:03.657 INFO:teuthology.orchestra.run.smithi081.stdout:5953 writesame 0x7aca847 thru 0x7acaf30 data_size 0xf(0x6ea bytes) 2024-09-18T00:33:03.660 INFO:teuthology.orchestra.run.smithi081.stdout:5954 read 0x106b4df thru 0x107883d (0xd35f bytes) 2024-09-18T00:33:03.661 INFO:teuthology.orchestra.run.smithi081.stdout:5955 read 0xab6acd2 thru 0xab70a37 (0x5d66 bytes) 2024-09-18T00:33:03.661 INFO:teuthology.orchestra.run.smithi081.stdout:5956 write 0x88320a thru 0x88d021 (0x9e18 bytes) 2024-09-18T00:33:03.694 INFO:teuthology.orchestra.run.smithi081.stdout:5959 trunc from 0xe5d9094 to 0xbe039a0 2024-09-18T00:33:03.705 INFO:teuthology.orchestra.run.smithi081.stdout:5960 write 0x43da41f thru 0x43e9f43 (0xfb25 bytes) 2024-09-18T00:33:03.709 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:03.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:03.709 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:03.710 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:03.710 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:03.717 INFO:teuthology.orchestra.run.smithi081.stdout:5961 write 0x44de868 thru 0x44e1590 (0x2d29 bytes) 2024-09-18T00:33:03.717 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:03.720 INFO:teuthology.orchestra.run.smithi081.stdout:5965 trunc from 0xbe039a0 to 0xaa377e0 2024-09-18T00:33:03.725 INFO:teuthology.orchestra.run.smithi081.stdout:5967 read 0x4624d15 thru 0x463080e (0xbafa bytes) 2024-09-18T00:33:03.725 INFO:teuthology.orchestra.run.smithi081.stdout:5968 trunc from 0xaa377e0 to 0xb07f89a 2024-09-18T00:33:03.732 INFO:teuthology.orchestra.run.smithi081.stdout:5970 writesame 0x196c6e7 thru 0x1977991 data_size 0x1(0xb2ab bytes) 2024-09-18T00:33:03.732 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:03.731+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:03.761 INFO:teuthology.orchestra.run.smithi081.stdout:5971 read 0x53529a1 thru 0x5357800 (0x4e60 bytes) 2024-09-18T00:33:03.761 INFO:teuthology.orchestra.run.smithi081.stdout:5975 write 0x5f6f954 thru 0x5f71650 (0x1cfd bytes) 2024-09-18T00:33:03.774 INFO:teuthology.orchestra.run.smithi081.stdout:5979 writesame 0xde27127 thru 0xde2a0f1 data_size 0x1(0x2fcb bytes) 2024-09-18T00:33:03.780 INFO:teuthology.orchestra.run.smithi081.stdout:5981 write 0xe4354d5 thru 0xe43987b (0x43a7 bytes) 2024-09-18T00:33:03.784 INFO:teuthology.orchestra.run.smithi081.stdout:5982 read 0x2aa4aea thru 0x2ab06e5 (0xbbfc bytes) 2024-09-18T00:33:03.784 INFO:teuthology.orchestra.run.smithi081.stdout:5983 write 0xdb49136 thru 0xdb4b14a (0x2015 bytes) 2024-09-18T00:33:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:5984 read 0x3776fe7 thru 0x377e518 (0x7532 bytes) 2024-09-18T00:33:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:5986 write 0x621ee4a thru 0x6223aee (0x4ca5 bytes) 2024-09-18T00:33:03.793 INFO:teuthology.orchestra.run.smithi081.stdout:5988 write 0xbb8194e thru 0xbb8943a (0x7aed bytes) 2024-09-18T00:33:03.803 INFO:teuthology.orchestra.run.smithi081.stdout:5989 read 0xc3a816b thru 0xc3ad107 (0x4f9d bytes) 2024-09-18T00:33:03.803 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-18T00:33:03.803 INFO:teuthology.orchestra.run.smithi081.stdout:5991 punch from 0x3a40936 to 0x3a4f9e3, (0xf0ad bytes) 2024-09-18T00:33:03.804 INFO:teuthology.orchestra.run.smithi081.stdout:5993 writesame 0x610ca27 thru 0x61156ac data_size 0x1(0x8c86 bytes) 2024-09-18T00:33:03.828 INFO:teuthology.orchestra.run.smithi081.stdout:5994 writesame 0x444884a thru 0x444aa18 data_size 0x5(0x21cf bytes) 2024-09-18T00:33:03.833 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:03.832+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:03.839 INFO:teuthology.orchestra.run.smithi081.stdout:5995 trunc from 0xe43987c to 0x735cae9 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:03.844 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.320605858, 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.308880640000002, 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:03.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.853 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.308587343999999, 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.308445176999999, 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.858 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.308143565999998, 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:03.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.302674069999998, 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:03.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.302653509999999, 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.302633018000002, 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:03.876 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:03.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.302613570999998, 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.301790252, 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:03.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:03.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.301771295999998, 2024-09-18T00:33:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:03.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.301737577000001, 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.301714115999999, 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.301694196, 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.301675198000002, 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.300892633, 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.300861969, 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.300840309000002, 2024-09-18T00:33:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.300819873999998, 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.298789238000001, 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:03.939 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:03.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:03.941 INFO:teuthology.orchestra.run.smithi081.stdout:5996 write 0xb4cfaa5 thru 0xb4dbd41 (0xc29d bytes) 2024-09-18T00:33:03.941 INFO:teuthology.orchestra.run.smithi081.stdout:5997 trunc from 0xb4dbd42 to 0x357b035 2024-09-18T00:33:03.941 INFO:teuthology.orchestra.run.smithi081.stdout:5998 writesame 0xa95af79 thru 0xa967a48 data_size 0x2c(0xcad0 bytes) 2024-09-18T00:33:03.941 INFO:teuthology.orchestra.run.smithi081.stdout:5999 read 0x32c92be thru 0x32d0156 (0x6e99 bytes) 2024-09-18T00:33:03.941 INFO:teuthology.orchestra.run.smithi081.stdout:6000 read 0x361c375 thru 0x3624fee (0x8c7a bytes) 2024-09-18T00:33:03.942 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:03.938+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:03.971 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #49, image image_client.0-clone49 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent50 2024-09-18T00:33:04.041 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:04.039+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:04.090 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:04.132 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:04.132 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:04.132 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:04.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:04.141 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:04.140+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:04.234 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:04.234 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:04.234 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-18T00:33:04.234 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T00:33:04.234 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T00:33:04.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-18T00:33:04.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:04.248 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:04.248 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:04.248 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:04.248 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:04.248 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:04.249 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:04.247+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:04.253 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:33:04.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:04.351 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T00:33:04.351 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:04.352 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:04.350+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:04.417 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.946583812999997, 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.946293097999998, 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.946246639000002, 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.946223142999997, 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.946200638000001, 2024-09-18T00:33:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.945690687999999, 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.945640599999997, 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.945609230000002, 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.945587142999997, 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.945565105, 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944403082999997, 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944371762999999, 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944339966999998, 2024-09-18T00:33:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944314855999998, 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944271389000001, 2024-09-18T00:33:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944249501999998, 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944192223999998, 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.944165134999999, 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 15.613535097, 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 15.613516068999999, 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:04.508 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:04.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:04.510 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:04.508+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:33:04.556+0000 7fa493fff640 0 --2- 172.21.15.81:0/3458047682 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa494141ec0 0x7fa494142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-18T00:33:04.581 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:04.598 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:04.610 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:04.609+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:04.614 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:04.614 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:04.616 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:04.616 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:04.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:04.630 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:04.630 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:04.647 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:04.664 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:04.664 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:04.681 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:04.698 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:04.711 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:04.709+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:04.734 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:04.734 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:04.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:04.826 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:04.825+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:04.885 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:04.885 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:04.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:04.935 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:04.933+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:05.014 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:05.013+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:05.036 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.036 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:05.115 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:05.114+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:05.146 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.146 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:05.216 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:05.215+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:05.258 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.259 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.269 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:05.318 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:05.316+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:05.391 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.392 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.401 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:05.418 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:05.417+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:05.519 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:05.518+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:05.545 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.545 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:05.620 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:05.619+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:05.698 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.698 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:05.752 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:05.750+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:05.812 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.812 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:05.822 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:05.819+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:05.921 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:05.920+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:05.965 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:05.965 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:05.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:06.058 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:06.057+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:06.118 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:06.118 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:06.123 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:06.122+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:06.127 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:06.224 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:06.222+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:06.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:33:06.275 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:06.275 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:06.285 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:06.325 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:06.324+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:06.425 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:06.424+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:06.431 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:06.431 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:06.440 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:06.526 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:06.525+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:06.585 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:06.585 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:06.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:06.628 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:06.627+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:06.697 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:06.697 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:06.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:06.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:06.750 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:06.749+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:06.810 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:06.810 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:06.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:06.829 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:06.827+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:06.851 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:06.867 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:06.883 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:06.900 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:06.901 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:06.917 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:06.917 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:06.930 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:06.928+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:06.933 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:06.950 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:06.951 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:06.967 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:06.967 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:06.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:06.967 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:06.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.967 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.376838796000001, 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.968 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:06.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:06.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.376773611000001, 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.973 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:06.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:06.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.376656701000002, 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.978 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:06.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:06.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.982 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.374945889999999, 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:06.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:06.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.372798338999999, 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.989 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:06.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:06.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.371014287000001, 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.993 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:06.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:06.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:06.997 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.370978251, 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:06.998 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:06.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:07.002 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.370968056999999, 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:07.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:07.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.370958213000002, 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.007 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:07.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368845777000001, 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:07.011 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:07.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.015 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368752008000001, 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.016 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368731318999998, 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.020 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:07.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:07.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:07.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368712534, 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:07.024 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:07.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:07.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368638464, 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368619011, 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.033 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:07.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368599647, 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:07.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:07.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368425598000002, 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.042 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.046 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.368395233000001, 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:07.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.366948365999999, 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.051 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:07.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:07.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 16.366922906999999, 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:07.055 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:07.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:07.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:07.059 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:07.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:07.061 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:07.059+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:07.161 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:07.160+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:07.164 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:07.164 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:07.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:07.262 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:07.261+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:07.280 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:33:07.327 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:07.327 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:07.327 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:07.327 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:07.327 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:07.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:07.363 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:07.362+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:07.464 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:07.463+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.95948915, 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.947763932000001, 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.947470635999998, 2024-09-18T00:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.947328468999999, 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.947026858000001, 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.941557362000001, 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.941536802000002, 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.941516310000001, 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.941496863000001, 2024-09-18T00:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.523 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.940673543999999, 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.940654588000001, 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.940620869, 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.940597407999999, 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.940577487999999, 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.940558490000001, 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939775924999999, 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939745260999999, 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939723601000001, 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939703166000001, 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.93767253, 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:07.571 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:07.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:07.573 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:07.571+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:07.674 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:07.672+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:07.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:07.808 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:07.807+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:07.874 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:07.873+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:07.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:07.976 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:07.974+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:08.023 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.023 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:08.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:08.023 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:08.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.552086662999997, 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.024 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:08.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:08.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551795947999999, 2024-09-18T00:33:08.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:08.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551749489000002, 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:08.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551725992999998, 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:08.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551703488000001, 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551193538, 2024-09-18T00:33:08.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:08.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:08.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551143449999998, 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:08.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:08.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551112080000003, 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:08.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:08.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551089992999998, 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:08.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:08.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.551067955000001, 2024-09-18T00:33:08.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:08.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549905932999998, 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:08.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549874613, 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.076 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:08.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:08.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549842816999998, 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:08.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549817705999999, 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.086 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549774239000001, 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549752351999999, 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:08.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549695073999999, 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.549667984999999, 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:08.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.219037947, 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:08.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:08.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:08.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.219018919, 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.112 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:08.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.116 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:08.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:08.118 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:08.116+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:08.219 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:08.218+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:08.221 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:08.221 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:08.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:08.320 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:08.318+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:08.345 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.345 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:08.345 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:08.345 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:08.345 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:08.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:08.421 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:08.420+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.924762963000006, 2024-09-18T00:33:08.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:08.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:08.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.780376507, 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:08.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:08.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:08.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.755059677999995, 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:08.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:08.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:08.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:08.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.631195258999995, 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:08.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.552486572999996, 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:08.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.552330287999993, 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.489 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.552145964000005, 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.434027610999998, 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:08.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.275854189, 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:08.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:08.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:08.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.274876255000002, 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:08.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.274149643000001, 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:08.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.390302878, 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:08.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.389260987999997, 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.384236301000001, 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:08.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.845018517, 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:08.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 47.415394022999998, 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:08.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.215149172, 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:08.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:33:08.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 20.147490762, 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:33:08.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:33:08.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.11318795, 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:08.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:33:08.547 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.112425379000001, 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.552 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:08.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:08.554 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:08.551+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:08.654 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:08.653+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:08.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:08.756 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:08.754+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:08.808 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:08.809 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:08.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:08.856 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:08.855+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:08.923 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.954105455999994, 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.953725798999997, 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.952896616000004, 2024-09-18T00:33:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:33:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.946112013000004, 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.946091546999995, 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.946067458000002, 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.944221495999997, 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.944157677000007, 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.944128797000005, 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.944103820999999, 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.944084769, 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.942135972000003, 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.942113515000003, 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.942085074999994, 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.942062766999996, 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.942042314999995, 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.941212866000001, 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.941171940999993, 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.941130693999995, 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.941108029000006, 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:09.014 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:09.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:09.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:09.016 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:09.014+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:09.116 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:09.114+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:09.132 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:09.132 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:09.133 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:09.133 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:09.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:09.174 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:09.191 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:09.207 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:09.207 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:09.223 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:09.223 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:09.225 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:09.224+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:09.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:09.240 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:09.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:09.272 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:09.289 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:09.289 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:09.294 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:09.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:33:09.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:09.343 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:09.341+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:09.362 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:09.362 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:09.363 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-18T00:33:09.363 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T00:33:09.363 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T00:33:09.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-18T00:33:09.418 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:09.416+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:09.451 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:09.451 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:09.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:09.474 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:09.474 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "" 2024-09-18T00:33:09.474 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:09.519 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:09.517+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:09.563 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:09.564 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:09.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:09.656 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:09.655+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:09.716 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:09.716 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:09.721 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:09.719+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:09.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:09.822 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:09.820+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:09.868 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:09.869 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:09.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:09.923 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:09.922+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:10.020 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.021 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.024 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:10.023+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:10.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:10.125 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:10.124+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:10.132 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.132 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:10.226 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:10.224+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:10.243 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.244 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:33:10.349 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:10.348+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:10.405 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.405 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:10.460 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:10.457+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:10.517 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.517 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:10.529 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:10.528+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:10.630 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:10.629+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:10.668 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.669 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:10.731 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:10.730+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:10.784 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.784 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:10.835 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:10.833+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:10.934 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:10.932+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:10.936 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:10.936 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:10.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:11.034 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:11.033+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:11.048 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:11.048 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:11.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:11.135 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:11.133+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:11.159 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:11.159 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:11.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:11.236 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:11.235+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:11.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:11.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:11.368 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:11.367+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:11.404 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:11.404 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:11.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:11.455 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:11.454+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:11.460 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:11.477 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:11.495 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:11.510 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:11.527 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:11.528 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:11.539 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:11.537+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:11.544 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:11.545 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:11.560 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:11.560 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:11.560 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:11.560 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:11.561 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:11.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:11.578 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:11.640 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:11.638+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:11.679 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:11.680 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:11.680 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:11.680 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:11.680 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:11.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:11.741 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:11.739+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.263517133999997, 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.119130678000005, 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:11.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.093813849, 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:11.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.96994943, 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:33:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:33:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.891240744000001, 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.891084458999998, 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.890900134999995, 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.772781781999996, 2024-09-18T00:33:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.614608359999998, 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.613630426, 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:11.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:11.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.847 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.612903813999999, 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:11.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.729057048999998, 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:11.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:11.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.728015159000002, 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:11.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.722990471999999, 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:11.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.183772687999998, 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:11.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:11.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:11.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.870 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.754148194000003, 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:11.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.553903343000002, 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:11.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.486244932999998, 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:33:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.451942120999998, 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.451179549999999, 2024-09-18T00:33:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:33:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:11.896 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:11.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:11.898 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:11.895+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:11.998 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:11.997+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:12.041 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:12.041 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:12.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:12.100 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:12.097+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:12.154 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:12.154 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:12.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:12.200 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:12.199+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.297516001000005, 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:12.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:12.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.297136343999995, 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:12.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.296307161000001, 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.289522558000002, 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:12.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:12.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:12.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.289502092000006, 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:12.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.289478002999999, 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:12.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.287632040999995, 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:12.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:12.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.287568222000004, 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:12.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:12.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.287539342000002, 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:12.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.287514365999996, 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.287495313999997, 2024-09-18T00:33:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.285546517, 2024-09-18T00:33:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:12.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.28552406, 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.285495620000006, 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:12.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:12.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.285473311999993, 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.332 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.336 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.285452860000007, 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:12.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.284623410999998, 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:12.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:12.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.284582486000005, 2024-09-18T00:33:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.284541239000006, 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.284518574000003, 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:12.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:12.359 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:12.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:33:12.361 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:12.361 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:12.359+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:12.461 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:12.459+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:12.467 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:12.467 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:12.467 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:12.467 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:12.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:12.562 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:12.561+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:12.579 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:12.579 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:12.579 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:12.579 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:12.579 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:12.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:12.663 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:12.662+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:12.692 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.54552735, 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545506887000002, 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:12.698 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:12.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:12.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:12.703 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545487491999999, 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:12.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545468337000003, 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:12.708 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:12.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545448907000001, 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:12.713 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:12.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:12.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545429251999998, 2024-09-18T00:33:12.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545410257999997, 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.725 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545371332999999, 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545351253, 2024-09-18T00:33:12.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:12.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:12.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:12.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:12.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.739 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545331509, 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:12.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:12.744 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545311730000002, 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:12.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:12.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.749 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545292142000001, 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.750 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.755 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545262676, 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.756 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:12.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:12.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.760 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545232343000002, 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:12.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545205613, 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.765 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:12.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.769 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545178215999996, 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:12.774 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545152573000003, 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:12.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:12.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:12.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545127667000003, 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:12.779 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:12.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:12.783 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545093496, 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.784 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.785 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.786 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:12.787 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:12.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 60.545055576000003, 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:12.789 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.790 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:12.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:12.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:12.794 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:12.796 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:33:12.796 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:12.797 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:12.794+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:12.896 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:12.895+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:12.953 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:12.953 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:12.953 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:12.953 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:12.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:13.004 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:13.002+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:13.098 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:13.097+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:13.107 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:13.107 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:13.107 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:13.107 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:13.107 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:13.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:13.199 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:13.198+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.221 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.417958780999996, 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:13.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.225 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.416028338000004, 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.226 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:33:13.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.230 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.416009998000007, 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.414419276999993, 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:33:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.414376043999994, 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:33:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.414177897000002, 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:33:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.414023505000003, 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.413809760000007, 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:13.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:33:13.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.413611364999994, 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.259 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:33:13.261 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.413250516999994, 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.262 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.263 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.264 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.265 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.409969519000001, 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.266 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.267 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:33:13.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:33:13.269 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.409950343999995, 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.271 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.272 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.408091240000005, 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.276 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:33:13.277 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:33:13.278 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.408066343000002, 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.279 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.280 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:33:13.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:33:13.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.408045838000007, 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.283 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.284 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.287 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.408027083999997, 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.288 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.289 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:33:13.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.406006802999997, 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.292 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:33:13.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.405988217000001, 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.296 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.297 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.298 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:33:13.299 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:13.300 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.405152303999998, 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:33:13.302 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.303 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.304 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 80.399977137999997, 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:33:13.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:33:13.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.307 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.309 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.309 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.309 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:13.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:13.311 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:13.308+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:13.411 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:13.410+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:13.414 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:13.414 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:13.414 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:13.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:13.512 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:13.510+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:13.525 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:13.525 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:13.525 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:13.525 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:13.525 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:13.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:13.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:13.635 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:13.634+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.316911098000006, 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.311562561000002, 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.307822836, 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:13.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.307798468000001, 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.691 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:13.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.695 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.307785887999998, 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:13.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:13.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:13.699 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.307775612, 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.700 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.704 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.295921428, 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:13.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.295901057999998, 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.709 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.293941421, 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.714 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:13.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.293932151999996, 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:13.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.722 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.291918851000005, 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:13.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.726 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.291900690000006, 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.727 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:13.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:13.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:13.730 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.289602806999994, 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:13.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.289562356999994, 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.738 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:13.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.289466860999994, 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.742 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:13.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.287891135999999, 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.287870417999997, 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.287846884999993, 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.287824287000007, 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 81.285868730000004, 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:13.765 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:13.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:13.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:13.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.771 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:13.771 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:13.771 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:13.772 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:13.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:13.774 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:13.770+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:13.775 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:13.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:13.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:13.828 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:13.846 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:13.899 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:13.898+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:13.926 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:13.927 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:13.935 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:13.980 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:13.979+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:14.039 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.039 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.047 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:14.075 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:14.073+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:14.175 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:14.174+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:14.190 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.191 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:14.276 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:14.275+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:14.308 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.308 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:14.377 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:14.375+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:14.419 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.419 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:14.483 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:14.484 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:14.484 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-18T00:33:14.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T00:33:14.513 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:14.510+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:14.574 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.574 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.578 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:14.577+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:14.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:14.679 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:14.677+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:14.690 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.690 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:14.785 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:14.782+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:14.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:33:14.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 101, 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "1111294f-f881-4427-a507-2f6f0939f89f", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-18T00:31:16.967705+0000", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-18T00:33:14.773901+0000", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-18T00:31:29.069471+0000", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-18T00:31:19.984105+0000", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5806080, 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nodeep-scrub", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-18T00:33:14.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 6, 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "squid", 2024-09-18T00:33:14.810 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:29.068996+0000", 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:33:14.811 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:33:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "17", 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:33:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:33:14.814 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:33:14.815 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 8, 2024-09-18T00:33:14.816 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.25, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.76266860961914062, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.75999999046325684, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.75999999046325684 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:35.737341+0000", 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:33:14.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-18T00:33:14.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "21", 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:33:14.819 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 2, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 21, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:33:14.820 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:33:14.821 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 2.9900000095367432, 2024-09-18T00:33:14.822 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 2.9900000095367432, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2.630000114440918, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2.630000114440918, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.76266860961914062, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.75999999046325684, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.75999999046325684 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-18T00:31:45.237398+0000", 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-18T00:33:14.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "is_stretch_pool": false, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-18T00:33:14.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "101", 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T00:33:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 52, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 101, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-18T00:33:14.826 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-18T00:33:14.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "score_type": "Fair distribution", 2024-09-18T00:33:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.75, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.75, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.75, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.75, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.76266860961914062, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.75999999046325684, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.75999999046325684 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:33:14.829 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "f3f5415f-ac86-4dd6-8c50-5391b44b9c6b", 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 85, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2689107883 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6803/2689107883", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6805/2689107883", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6809/2689107883", 2024-09-18T00:33:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6807/2689107883", 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "06a47ef1-1ae7-40a2-a998-daac122fc229", 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.835 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-18T00:33:14.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-18T00:33:14.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1726163291 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6813/1726163291", 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6817/1726163291", 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6825/1726163291", 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6821/1726163291", 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.840 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "653ab61a-1037-4190-8806-7042ef3d0586", 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.0070343017578125, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 18, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 365910818 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6812/365910818", 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6816/365910818", 2024-09-18T00:33:14.845 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6824/365910818", 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6820/365910818", 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f", 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:33:14.846 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 14, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 73, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6832", 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6833", 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2780316581 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6827/2780316581", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6829/2780316581", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6833/2780316581", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6831/2780316581", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "7000f249-35b4-4770-8452-8f31064ef1de", 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 85, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.852 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6824", 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6825", 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6826", 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6827", 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6830", 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6831", 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6828", 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6829", 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2008948201 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6825/2008948201", 2024-09-18T00:33:14.856 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6827/2008948201", 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6831/2008948201", 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6829/2008948201", 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "755442b3-b418-409d-bd0a-376579eeb381", 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.857 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6816", 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6817", 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6818", 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6819", 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6822", 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6823", 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6820", 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6821", 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2331356901 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6817/2331356901", 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6819/2331356901", 2024-09-18T00:33:14.862 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6823/2331356901", 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6821/2331356901", 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6b406b2b-e850-41be-bce8-9f13d2921c60", 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.0943145751953125, 2024-09-18T00:33:14.863 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 23, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6800", 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6801", 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6802", 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6803", 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6806", 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6807", 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6804", 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6805", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2657673991 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6801/2657673991", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6803/2657673991", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6807/2657673991", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6805/2657673991", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "8bb8987f-d8e4-494e-82ce-e1203957c35f", 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 15, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 85, 2024-09-18T00:33:14.869 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6808", 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6809", 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6810", 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6811", 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6814", 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6815", 2024-09-18T00:33:14.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6812", 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-18T00:33:14.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.167:6813", 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2652298701 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.167:6809/2652298701", 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.167:6811/2652298701", 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.167:6815/2652298701", 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.167:6813/2652298701", 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-18T00:33:14.874 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.022758+0000", 2024-09-18T00:33:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:27.126737+0000", 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.876 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.821608+0000", 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.574908+0000", 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.569036+0000", 2024-09-18T00:33:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.436338+0000", 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-18T00:33:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.050552+0000", 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-18T00:33:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540701547738038271, 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-18T00:31:26.299077+0000", 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-18T00:33:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 42, 2024-09-18T00:33:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 9 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [ 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 42, 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:14.886 INFO:tasks.thrashosds.thrasher:j is {'epoch': 101, 'fsid': '1111294f-f881-4427-a507-2f6f0939f89f', 'created': '2024-09-18T00:31:16.967705+0000', 'modified': '2024-09-18T00:33:14.773901+0000', 'last_up_change': '2024-09-18T00:31:29.069471+0000', 'last_in_change': '2024-09-18T00:31:19.984105+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T00:31:29.068996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7626686096191406, 'average_primary_affinity': 0.7599999904632568, 'average_primary_affinity_weighted': 0.7599999904632568}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T00:31:35.737341+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.7626686096191406, 'average_primary_affinity': 0.7599999904632568, 'average_primary_affinity_weighted': 0.7599999904632568}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-18T00:31:45.237398+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 52, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.7626686096191406, 'average_primary_affinity': 0.7599999904632568, 'average_primary_affinity_weighted': 0.7599999904632568}}], 'osds': [{'osd': 0, 'uuid': 'f3f5415f-ac86-4dd6-8c50-5391b44b9c6b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 85, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 2689107883}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 2689107883}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 2689107883}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 2689107883}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 2689107883}]}, 'public_addr': '172.21.15.81:6803/2689107883', 'cluster_addr': '172.21.15.81:6805/2689107883', 'heartbeat_back_addr': '172.21.15.81:6809/2689107883', 'heartbeat_front_addr': '172.21.15.81:6807/2689107883', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '06a47ef1-1ae7-40a2-a998-daac122fc229', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6811', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1726163291}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6815', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6817', 'nonce': 1726163291}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 1726163291}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6819', 'nonce': 1726163291}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 1726163291}]}, 'public_addr': '172.21.15.81:6813/1726163291', 'cluster_addr': '172.21.15.81:6817/1726163291', 'heartbeat_back_addr': '172.21.15.81:6825/1726163291', 'heartbeat_front_addr': '172.21.15.81:6821/1726163291', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '653ab61a-1037-4190-8806-7042ef3d0586', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0070343017578125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6812', 'nonce': 365910818}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6816', 'nonce': 365910818}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 365910818}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6818', 'nonce': 365910818}, {'type': 'v1', 'addr': '172.21.15.81:6820', 'nonce': 365910818}]}, 'public_addr': '172.21.15.81:6812/365910818', 'cluster_addr': '172.21.15.81:6816/365910818', 'heartbeat_back_addr': '172.21.15.81:6824/365910818', 'heartbeat_front_addr': '172.21.15.81:6820/365910818', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6827', 'nonce': 2780316581}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6828', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 2780316581}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 2780316581}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 2780316581}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 2780316581}]}, 'public_addr': '172.21.15.81:6827/2780316581', 'cluster_addr': '172.21.15.81:6829/2780316581', 'heartbeat_back_addr': '172.21.15.81:6833/2780316581', 'heartbeat_front_addr': '172.21.15.81:6831/2780316581', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7000f249-35b4-4770-8452-8f31064ef1de', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 85, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6824', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6825', 'nonce': 2008948201}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6826', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6827', 'nonce': 2008948201}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6830', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6831', 'nonce': 2008948201}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6828', 'nonce': 2008948201}, {'type': 'v1', 'addr': '172.21.15.167:6829', 'nonce': 2008948201}]}, 'public_addr': '172.21.15.167:6825/2008948201', 'cluster_addr': '172.21.15.167:6827/2008948201', 'heartbeat_back_addr': '172.21.15.167:6831/2008948201', 'heartbeat_front_addr': '172.21.15.167:6829/2008948201', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '755442b3-b418-409d-bd0a-376579eeb381', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6816', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6817', 'nonce': 2331356901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6818', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6819', 'nonce': 2331356901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6822', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6823', 'nonce': 2331356901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6820', 'nonce': 2331356901}, {'type': 'v1', 'addr': '172.21.15.167:6821', 'nonce': 2331356901}]}, 'public_addr': '172.21.15.167:6817/2331356901', 'cluster_addr': '172.21.15.167:6819/2331356901', 'heartbeat_back_addr': '172.21.15.167:6823/2331356901', 'heartbeat_front_addr': '172.21.15.167:6821/2331356901', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6b406b2b-e850-41be-bce8-9f13d2921c60', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0943145751953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6800', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6801', 'nonce': 2657673991}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6802', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6803', 'nonce': 2657673991}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6806', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6807', 'nonce': 2657673991}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6804', 'nonce': 2657673991}, {'type': 'v1', 'addr': '172.21.15.167:6805', 'nonce': 2657673991}]}, 'public_addr': '172.21.15.167:6801/2657673991', 'cluster_addr': '172.21.15.167:6803/2657673991', 'heartbeat_back_addr': '172.21.15.167:6807/2657673991', 'heartbeat_front_addr': '172.21.15.167:6805/2657673991', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '8bb8987f-d8e4-494e-82ce-e1203957c35f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 85, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6808', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6809', 'nonce': 2652298701}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6810', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6811', 'nonce': 2652298701}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6814', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6815', 'nonce': 2652298701}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6812', 'nonce': 2652298701}, {'type': 'v1', 'addr': '172.21.15.167:6813', 'nonce': 2652298701}]}, 'public_addr': '172.21.15.167:6809/2652298701', 'cluster_addr': '172.21.15.167:6811/2652298701', 'heartbeat_back_addr': '172.21.15.167:6815/2652298701', 'heartbeat_front_addr': '172.21.15.167:6813/2652298701', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.022758+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:27.126737+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.821608+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.574908+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.569036+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.436338+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.050552+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T00:31:26.299077+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T00:33:14.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:33:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:14.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:14.888 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:14.884+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:14.987 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:14.984+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:15.042 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.042 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:15.088 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:15.086+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:15.188 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:15.186+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:15.197 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.198 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:15.225 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:33:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:33:15.237 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-18T00:33:15.054947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1748341180,"num_objects":1820,"num_object_clones":489,"num_object_copies":3640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1820,"num_whiteouts":562,"num_read":206264,"num_read_kb":1000901,"num_write":20567,"num_write_kb":487198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17315,"ondisk_log_size":17315,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":446940,"kb_used_data":68308,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754527780,"statfs":{"total":773094113280,"available":772636446720,"internally_reserved":0,"allocated":69947392,"data_stored":704207959,"data_compressed":17995733,"data_compressed_allocated":48676864,"data_compressed_original":692911744,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38430924,"num_objects":-74,"num_object_clones":-22,"num_object_copies":-148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-74,"num_whiteouts":-6,"num_read":947,"num_read_kb":804,"num_write":123,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.756700"},"pg_stats":[{"pgid":"3.1f","version":"98'444","reported_seq":5380,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.785922+0000","last_change":"2024-09-18T00:33:11.785922+0000","last_active":"2024-09-18T00:33:11.785922+0000","last_peered":"2024-09-18T00:33:11.785922+0000","last_clean":"2024-09-18T00:33:11.785922+0000","last_became_active":"2024-09-18T00:31:46.857203+0000","last_became_peered":"2024-09-18T00:31:46.857203+0000","last_unstale":"2024-09-18T00:33:11.785922+0000","last_undegraded":"2024-09-18T00:33:11.785922+0000","last_fullsized":"2024-09-18T00:33:11.785922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:15:03.960524+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0083003839999999992,"stat_sum":{"num_bytes":45329362,"num_objects":54,"num_object_clones":17,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":18,"num_read":7408,"num_read_kb":54249,"num_write":414,"num_write_kb":24355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"3.1e","version":"100'544","reported_seq":3797,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.895088+0000","last_change":"2024-09-18T00:33:13.777355+0000","last_active":"2024-09-18T00:33:13.895088+0000","last_peered":"2024-09-18T00:33:13.895088+0000","last_clean":"2024-09-18T00:33:13.895088+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:33:13.895088+0000","last_undegraded":"2024-09-18T00:33:13.895088+0000","last_fullsized":"2024-09-18T00:33:13.895088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:53:11.841101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001493709,"stat_sum":{"num_bytes":27278096,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":5174,"num_read_kb":45320,"num_write":816,"num_write_kb":24874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b","length":"8"}]},{"pgid":"3.1d","version":"95'494","reported_seq":6192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.429332+0000","last_change":"2024-09-18T00:33:09.308361+0000","last_active":"2024-09-18T00:33:09.429332+0000","last_peered":"2024-09-18T00:33:09.429332+0000","last_clean":"2024-09-18T00:33:09.429332+0000","last_became_active":"2024-09-18T00:31:46.855003+0000","last_became_peered":"2024-09-18T00:31:46.855003+0000","last_unstale":"2024-09-18T00:33:09.429332+0000","last_undegraded":"2024-09-18T00:33:09.429332+0000","last_fullsized":"2024-09-18T00:33:09.429332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:04.100973+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.013152326000000001,"stat_sum":{"num_bytes":87131495,"num_objects":77,"num_object_clones":22,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":24,"num_read":7177,"num_read_kb":44251,"num_write":470,"num_write_kb":21543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.1c","version":"95'648","reported_seq":5962,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.380789+0000","last_change":"2024-09-18T00:33:09.305220+0000","last_active":"2024-09-18T00:33:09.380789+0000","last_peered":"2024-09-18T00:33:09.380789+0000","last_clean":"2024-09-18T00:33:09.380789+0000","last_became_active":"2024-09-18T00:31:46.854720+0000","last_became_peered":"2024-09-18T00:31:46.854720+0000","last_unstale":"2024-09-18T00:33:09.380789+0000","last_undegraded":"2024-09-18T00:33:09.380789+0000","last_fullsized":"2024-09-18T00:33:09.380789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:00.466508+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.010156137000000001,"stat_sum":{"num_bytes":118890495,"num_objects":71,"num_object_clones":20,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":22,"num_read":6650,"num_read_kb":23550,"num_write":795,"num_write_kb":16070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.1b","version":"98'764","reported_seq":3635,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.781851+0000","last_change":"2024-09-18T00:33:11.781851+0000","last_active":"2024-09-18T00:33:11.781851+0000","last_peered":"2024-09-18T00:33:11.781851+0000","last_clean":"2024-09-18T00:33:11.781851+0000","last_became_active":"2024-09-18T00:31:46.859322+0000","last_became_peered":"2024-09-18T00:31:46.859322+0000","last_unstale":"2024-09-18T00:33:11.781851+0000","last_undegraded":"2024-09-18T00:33:11.781851+0000","last_fullsized":"2024-09-18T00:33:11.781851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:40.316845+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0049481860000000003,"stat_sum":{"num_bytes":25971188,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":16,"num_read":5469,"num_read_kb":15964,"num_write":1167,"num_write_kb":7580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"3.1a","version":"92'335","reported_seq":9658,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.416982+0000","last_change":"2024-09-18T00:33:09.289758+0000","last_active":"2024-09-18T00:33:09.416982+0000","last_peered":"2024-09-18T00:33:09.416982+0000","last_clean":"2024-09-18T00:33:09.416982+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:33:09.416982+0000","last_undegraded":"2024-09-18T00:33:09.416982+0000","last_fullsized":"2024-09-18T00:33:09.416982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:40:34.771379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070298099999999998,"stat_sum":{"num_bytes":114946290,"num_objects":72,"num_object_clones":20,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":18,"num_read":9525,"num_read_kb":51946,"num_write":369,"num_write_kb":47258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.19","version":"95'626","reported_seq":2169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.283842+0000","last_change":"2024-09-18T00:33:09.283842+0000","last_active":"2024-09-18T00:33:09.283842+0000","last_peered":"2024-09-18T00:33:09.283842+0000","last_clean":"2024-09-18T00:33:09.283842+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:33:09.283842+0000","last_undegraded":"2024-09-18T00:33:09.283842+0000","last_fullsized":"2024-09-18T00:33:09.283842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:54:56.161905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056846800000000003,"stat_sum":{"num_bytes":35640053,"num_objects":47,"num_object_clones":6,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":7,"num_read":3780,"num_read_kb":23218,"num_write":918,"num_write_kb":9768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.18","version":"99'354","reported_seq":5481,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.776091+0000","last_change":"2024-09-18T00:33:13.776496+0000","last_active":"2024-09-18T00:33:13.776091+0000","last_peered":"2024-09-18T00:33:13.776091+0000","last_clean":"2024-09-18T00:33:13.776091+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:33:13.776091+0000","last_undegraded":"2024-09-18T00:33:13.776091+0000","last_fullsized":"2024-09-18T00:33:13.776091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:11:38.093707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086794599999999997,"stat_sum":{"num_bytes":35808844,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":5585,"num_read_kb":29891,"num_write":360,"num_write_kb":10802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b","length":"8"}]},{"pgid":"3.17","version":"97'954","reported_seq":4503,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.782738+0000","last_change":"2024-09-18T00:33:11.783345+0000","last_active":"2024-09-18T00:33:11.782738+0000","last_peered":"2024-09-18T00:33:11.782738+0000","last_clean":"2024-09-18T00:33:11.782738+0000","last_became_active":"2024-09-18T00:31:46.858297+0000","last_became_peered":"2024-09-18T00:31:46.858297+0000","last_unstale":"2024-09-18T00:33:11.782738+0000","last_undegraded":"2024-09-18T00:33:11.782738+0000","last_fullsized":"2024-09-18T00:33:11.782738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:41.948091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051791930000000003,"stat_sum":{"num_bytes":59954575,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":8353,"num_read_kb":43885,"num_write":1452,"num_write_kb":16811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"3.16","version":"89'552","reported_seq":3078,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.295394+0000","last_change":"2024-09-18T00:33:09.295743+0000","last_active":"2024-09-18T00:33:09.295394+0000","last_peered":"2024-09-18T00:33:09.295394+0000","last_clean":"2024-09-18T00:33:09.295394+0000","last_became_active":"2024-09-18T00:31:46.851617+0000","last_became_peered":"2024-09-18T00:31:46.851617+0000","last_unstale":"2024-09-18T00:33:09.295394+0000","last_undegraded":"2024-09-18T00:33:09.295394+0000","last_fullsized":"2024-09-18T00:33:09.295394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:04:03.432683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058600899999999997,"stat_sum":{"num_bytes":32504203,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":4760,"num_read_kb":13437,"num_write":651,"num_write_kb":6902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.15","version":"93'554","reported_seq":5281,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.300746+0000","last_change":"2024-09-18T00:33:09.301229+0000","last_active":"2024-09-18T00:33:09.300746+0000","last_peered":"2024-09-18T00:33:09.300746+0000","last_clean":"2024-09-18T00:33:09.300746+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:33:09.300746+0000","last_undegraded":"2024-09-18T00:33:09.300746+0000","last_fullsized":"2024-09-18T00:33:09.300746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:40:49.758199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01121577,"stat_sum":{"num_bytes":88474837,"num_objects":59,"num_object_clones":15,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":21,"num_read":6054,"num_read_kb":21044,"num_write":659,"num_write_kb":9156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.14","version":"92'394","reported_seq":6021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.295283+0000","last_change":"2024-09-18T00:33:09.295666+0000","last_active":"2024-09-18T00:33:09.295283+0000","last_peered":"2024-09-18T00:33:09.295283+0000","last_clean":"2024-09-18T00:33:09.295283+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:33:09.295283+0000","last_undegraded":"2024-09-18T00:33:09.295283+0000","last_fullsized":"2024-09-18T00:33:09.295283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:12:42.382367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006398328,"stat_sum":{"num_bytes":50693249,"num_objects":56,"num_object_clones":19,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":5970,"num_read_kb":34530,"num_write":441,"num_write_kb":18979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.288950+0000","last_change":"2024-09-18T00:33:00.228867+0000","last_active":"2024-09-18T00:33:09.288950+0000","last_peered":"2024-09-18T00:33:09.288950+0000","last_clean":"2024-09-18T00:33:09.288950+0000","last_became_active":"2024-09-18T00:33:00.228557+0000","last_became_peered":"2024-09-18T00:33:00.228557+0000","last_unstale":"2024-09-18T00:33:09.288950+0000","last_undegraded":"2024-09-18T00:33:09.288950+0000","last_fullsized":"2024-09-18T00:33:09.288950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:31:40.368490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"98'258","reported_seq":2033,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.782564+0000","last_change":"2024-09-18T00:33:11.782564+0000","last_active":"2024-09-18T00:33:11.782564+0000","last_peered":"2024-09-18T00:33:11.782564+0000","last_clean":"2024-09-18T00:33:11.782564+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:33:11.782564+0000","last_undegraded":"2024-09-18T00:33:11.782564+0000","last_fullsized":"2024-09-18T00:33:11.782564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:38.292242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050242819999999997,"stat_sum":{"num_bytes":23318609,"num_objects":44,"num_object_clones":15,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":14,"num_read":1749,"num_read_kb":13646,"num_write":256,"num_write_kb":9707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"2.6","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.283576+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:33:09.283576+0000","last_peered":"2024-09-18T00:33:09.283576+0000","last_clean":"2024-09-18T00:33:09.283576+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:33:09.283576+0000","last_undegraded":"2024-09-18T00:33:09.283576+0000","last_fullsized":"2024-09-18T00:33:09.283576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"100'483","reported_seq":3423,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.782807+0000","last_change":"2024-09-18T00:33:13.782807+0000","last_active":"2024-09-18T00:33:13.782807+0000","last_peered":"2024-09-18T00:33:13.782807+0000","last_clean":"2024-09-18T00:33:13.782807+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:33:13.782807+0000","last_undegraded":"2024-09-18T00:33:13.782807+0000","last_fullsized":"2024-09-18T00:33:13.782807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:34.404095+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0068771759999999996,"stat_sum":{"num_bytes":29927158,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":21,"num_read":3791,"num_read_kb":10031,"num_write":582,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b","length":"8"}]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.290161+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:33:09.290161+0000","last_peered":"2024-09-18T00:33:09.290161+0000","last_clean":"2024-09-18T00:33:09.290161+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:33:09.290161+0000","last_undegraded":"2024-09-18T00:33:09.290161+0000","last_fullsized":"2024-09-18T00:33:09.290161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"93'518","reported_seq":3598,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.283657+0000","last_change":"2024-09-18T00:33:09.284163+0000","last_active":"2024-09-18T00:33:09.283657+0000","last_peered":"2024-09-18T00:33:09.283657+0000","last_clean":"2024-09-18T00:33:09.283657+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:33:09.283657+0000","last_undegraded":"2024-09-18T00:33:09.283657+0000","last_fullsized":"2024-09-18T00:33:09.283657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:48:56.651327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076668899999999998,"stat_sum":{"num_bytes":82464999,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":4104,"num_read_kb":10470,"num_write":482,"num_write_kb":6869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.283506+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:33:09.283506+0000","last_peered":"2024-09-18T00:33:09.283506+0000","last_clean":"2024-09-18T00:33:09.283506+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:33:09.283506+0000","last_undegraded":"2024-09-18T00:33:09.283506+0000","last_fullsized":"2024-09-18T00:33:09.283506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'907","reported_seq":4643,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.431679+0000","last_change":"2024-09-18T00:33:09.308633+0000","last_active":"2024-09-18T00:33:09.431679+0000","last_peered":"2024-09-18T00:33:09.431679+0000","last_clean":"2024-09-18T00:33:09.431679+0000","last_became_active":"2024-09-18T00:31:46.852261+0000","last_became_peered":"2024-09-18T00:31:46.852261+0000","last_unstale":"2024-09-18T00:33:09.431679+0000","last_undegraded":"2024-09-18T00:33:09.431679+0000","last_fullsized":"2024-09-18T00:33:09.431679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:16:51.226324+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013240238999999999,"stat_sum":{"num_bytes":71944191,"num_objects":64,"num_object_clones":14,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":20,"num_read":7079,"num_read_kb":18273,"num_write":1228,"num_write_kb":5675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.3","version":"95'380","reported_seq":2609,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.401427+0000","last_change":"2024-09-18T00:33:09.302990+0000","last_active":"2024-09-18T00:33:09.401427+0000","last_peered":"2024-09-18T00:33:09.401427+0000","last_clean":"2024-09-18T00:33:09.401427+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:33:09.401427+0000","last_undegraded":"2024-09-18T00:33:09.401427+0000","last_fullsized":"2024-09-18T00:33:09.401427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:43:12.494074+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013547515,"stat_sum":{"num_bytes":36593897,"num_objects":47,"num_object_clones":11,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":17,"num_read":2861,"num_read_kb":16529,"num_write":344,"num_write_kb":6151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"2.2","version":"21'2","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.295194+0000","last_change":"2024-09-18T00:31:39.159412+0000","last_active":"2024-09-18T00:33:09.295194+0000","last_peered":"2024-09-18T00:33:09.295194+0000","last_clean":"2024-09-18T00:33:09.295194+0000","last_became_active":"2024-09-18T00:31:37.141833+0000","last_became_peered":"2024-09-18T00:31:37.141833+0000","last_unstale":"2024-09-18T00:33:09.295194+0000","last_undegraded":"2024-09-18T00:33:09.295194+0000","last_fullsized":"2024-09-18T00:33:09.295194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097492499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"95'376","reported_seq":2022,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.285502+0000","last_change":"2024-09-18T00:33:09.285900+0000","last_active":"2024-09-18T00:33:09.285502+0000","last_peered":"2024-09-18T00:33:09.285502+0000","last_clean":"2024-09-18T00:33:09.285502+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:33:09.285502+0000","last_undegraded":"2024-09-18T00:33:09.285502+0000","last_fullsized":"2024-09-18T00:33:09.285502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:19:33.081305+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0024485090000000002,"stat_sum":{"num_bytes":57222882,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":1608,"num_read_kb":13619,"num_write":303,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.775702+0000","last_change":"2024-09-18T00:32:44.247377+0000","last_active":"2024-09-18T00:33:13.775702+0000","last_peered":"2024-09-18T00:33:13.775702+0000","last_clean":"2024-09-18T00:33:13.775702+0000","last_became_active":"2024-09-18T00:32:44.247070+0000","last_became_peered":"2024-09-18T00:32:44.247070+0000","last_unstale":"2024-09-18T00:33:13.775702+0000","last_undegraded":"2024-09-18T00:33:13.775702+0000","last_fullsized":"2024-09-18T00:33:13.775702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:30:02.871222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"98'546","reported_seq":8993,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.895997+0000","last_change":"2024-09-18T00:33:11.782566+0000","last_active":"2024-09-18T00:33:11.895997+0000","last_peered":"2024-09-18T00:33:11.895997+0000","last_clean":"2024-09-18T00:33:11.895997+0000","last_became_active":"2024-09-18T00:31:46.858165+0000","last_became_peered":"2024-09-18T00:31:46.858165+0000","last_unstale":"2024-09-18T00:33:11.895997+0000","last_undegraded":"2024-09-18T00:33:11.895997+0000","last_fullsized":"2024-09-18T00:33:11.895997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:54.979748+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.005352473,"stat_sum":{"num_bytes":56635401,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":16,"num_read":9725,"num_read_kb":60747,"num_write":589,"num_write_kb":19305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.288400+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:33:09.288400+0000","last_peered":"2024-09-18T00:33:09.288400+0000","last_clean":"2024-09-18T00:33:09.288400+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:33:09.288400+0000","last_undegraded":"2024-09-18T00:33:09.288400+0000","last_fullsized":"2024-09-18T00:33:09.288400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"89'437","reported_seq":5180,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.777418+0000","last_change":"2024-09-18T00:33:13.777838+0000","last_active":"2024-09-18T00:33:13.777418+0000","last_peered":"2024-09-18T00:33:13.777418+0000","last_clean":"2024-09-18T00:33:13.777418+0000","last_became_active":"2024-09-18T00:31:46.853986+0000","last_became_peered":"2024-09-18T00:31:46.853986+0000","last_unstale":"2024-09-18T00:33:13.777418+0000","last_undegraded":"2024-09-18T00:33:13.777418+0000","last_fullsized":"2024-09-18T00:33:13.777418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:12.145616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015420130000000001,"stat_sum":{"num_bytes":46248138,"num_objects":59,"num_object_clones":19,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":21,"num_read":5556,"num_read_kb":32910,"num_write":440,"num_write_kb":23251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b","length":"8"}]},{"pgid":"2.3","version":"19'1","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.294984+0000","last_change":"2024-09-18T00:31:39.158895+0000","last_active":"2024-09-18T00:33:09.294984+0000","last_peered":"2024-09-18T00:33:09.294984+0000","last_clean":"2024-09-18T00:33:09.294984+0000","last_became_active":"2024-09-18T00:31:37.142804+0000","last_became_peered":"2024-09-18T00:31:37.142804+0000","last_unstale":"2024-09-18T00:33:09.294984+0000","last_undegraded":"2024-09-18T00:33:09.294984+0000","last_fullsized":"2024-09-18T00:33:09.294984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:42.283327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000455124,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.288517+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:33:09.288517+0000","last_peered":"2024-09-18T00:33:09.288517+0000","last_clean":"2024-09-18T00:33:09.288517+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:33:09.288517+0000","last_undegraded":"2024-09-18T00:33:09.288517+0000","last_fullsized":"2024-09-18T00:33:09.288517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"98'426","reported_seq":7182,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.776141+0000","last_change":"2024-09-18T00:33:13.777040+0000","last_active":"2024-09-18T00:33:13.776141+0000","last_peered":"2024-09-18T00:33:13.776141+0000","last_clean":"2024-09-18T00:33:13.776141+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:33:13.776141+0000","last_undegraded":"2024-09-18T00:33:13.776141+0000","last_fullsized":"2024-09-18T00:33:13.776141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:48.045414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00120126,"stat_sum":{"num_bytes":41705602,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":9585,"num_read_kb":45510,"num_write":401,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b","length":"8"}]},{"pgid":"3.9","version":"95'446","reported_seq":7875,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.295500+0000","last_change":"2024-09-18T00:33:09.295500+0000","last_active":"2024-09-18T00:33:09.295500+0000","last_peered":"2024-09-18T00:33:09.295500+0000","last_clean":"2024-09-18T00:33:09.295500+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:33:09.295500+0000","last_undegraded":"2024-09-18T00:33:09.295500+0000","last_fullsized":"2024-09-18T00:33:09.295500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:53:26.427170+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0061442190000000002,"stat_sum":{"num_bytes":64398077,"num_objects":62,"num_object_clones":19,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":21,"num_read":8962,"num_read_kb":40434,"num_write":505,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.a","version":"95'322","reported_seq":5878,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.383090+0000","last_change":"2024-09-18T00:33:09.300669+0000","last_active":"2024-09-18T00:33:09.383090+0000","last_peered":"2024-09-18T00:33:09.383090+0000","last_clean":"2024-09-18T00:33:09.383090+0000","last_became_active":"2024-09-18T00:33:00.228554+0000","last_became_peered":"2024-09-18T00:33:00.228554+0000","last_unstale":"2024-09-18T00:33:09.383090+0000","last_undegraded":"2024-09-18T00:33:09.383090+0000","last_fullsized":"2024-09-18T00:33:09.383090+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:44.199229+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.011613861,"stat_sum":{"num_bytes":28955699,"num_objects":59,"num_object_clones":19,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":20,"num_read":5964,"num_read_kb":20264,"num_write":290,"num_write_kb":5061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.b","version":"97'598","reported_seq":4973,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T00:33:13.777920+0000","last_change":"2024-09-18T00:33:13.780991+0000","last_active":"2024-09-18T00:33:13.777920+0000","last_peered":"2024-09-18T00:33:13.777920+0000","last_clean":"2024-09-18T00:33:13.777920+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:33:13.777920+0000","last_undegraded":"2024-09-18T00:33:13.777920+0000","last_fullsized":"2024-09-18T00:33:13.777920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:04:27.442689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040614689999999998,"stat_sum":{"num_bytes":34773642,"num_objects":59,"num_object_clones":15,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":22,"num_read":7713,"num_read_kb":37717,"num_write":575,"num_write_kb":21337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2b","length":"8"}]},{"pgid":"3.c","version":"95'324","reported_seq":4572,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.305437+0000","last_change":"2024-09-18T00:33:09.305437+0000","last_active":"2024-09-18T00:33:09.305437+0000","last_peered":"2024-09-18T00:33:09.305437+0000","last_clean":"2024-09-18T00:33:09.305437+0000","last_became_active":"2024-09-18T00:31:46.851057+0000","last_became_peered":"2024-09-18T00:31:46.851057+0000","last_unstale":"2024-09-18T00:33:09.305437+0000","last_undegraded":"2024-09-18T00:33:09.305437+0000","last_fullsized":"2024-09-18T00:33:09.305437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:59:56.024209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010210992,"stat_sum":{"num_bytes":49654459,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":22,"num_read":4246,"num_read_kb":24869,"num_write":330,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.d","version":"95'513","reported_seq":6257,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.307848+0000","last_change":"2024-09-18T00:33:09.308063+0000","last_active":"2024-09-18T00:33:09.307848+0000","last_peered":"2024-09-18T00:33:09.307848+0000","last_clean":"2024-09-18T00:33:09.307848+0000","last_became_active":"2024-09-18T00:31:46.853922+0000","last_became_peered":"2024-09-18T00:31:46.853922+0000","last_unstale":"2024-09-18T00:33:09.307848+0000","last_undegraded":"2024-09-18T00:33:09.307848+0000","last_fullsized":"2024-09-18T00:33:09.307848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:08:10.683821+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.017415205,"stat_sum":{"num_bytes":79650458,"num_objects":70,"num_object_clones":24,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":21,"num_read":7819,"num_read_kb":22418,"num_write":499,"num_write_kb":6716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.e","version":"95'637","reported_seq":10638,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.405581+0000","last_change":"2024-09-18T00:33:09.300679+0000","last_active":"2024-09-18T00:33:09.405581+0000","last_peered":"2024-09-18T00:33:09.405581+0000","last_clean":"2024-09-18T00:33:09.405581+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:33:09.405581+0000","last_undegraded":"2024-09-18T00:33:09.405581+0000","last_fullsized":"2024-09-18T00:33:09.405581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:13.779586+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011511423999999999,"stat_sum":{"num_bytes":46056185,"num_objects":70,"num_object_clones":23,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":12415,"num_read_kb":38781,"num_write":754,"num_write_kb":10453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.f","version":"89'497","reported_seq":5416,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.290327+0000","last_change":"2024-09-18T00:33:09.290513+0000","last_active":"2024-09-18T00:33:09.290327+0000","last_peered":"2024-09-18T00:33:09.290327+0000","last_clean":"2024-09-18T00:33:09.290327+0000","last_became_active":"2024-09-18T00:31:46.858825+0000","last_became_peered":"2024-09-18T00:31:46.858825+0000","last_unstale":"2024-09-18T00:33:09.290327+0000","last_undegraded":"2024-09-18T00:33:09.290327+0000","last_fullsized":"2024-09-18T00:33:09.290327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:24:47.076663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671613,"stat_sum":{"num_bytes":52622180,"num_objects":69,"num_object_clones":17,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":20,"num_read":7201,"num_read_kb":29166,"num_write":541,"num_write_kb":10852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.10","version":"97'532","reported_seq":4811,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.777680+0000","last_change":"2024-09-18T00:33:11.778275+0000","last_active":"2024-09-18T00:33:11.777680+0000","last_peered":"2024-09-18T00:33:11.777680+0000","last_clean":"2024-09-18T00:33:11.777680+0000","last_became_active":"2024-09-18T00:33:00.231493+0000","last_became_peered":"2024-09-18T00:33:00.231493+0000","last_unstale":"2024-09-18T00:33:11.777680+0000","last_undegraded":"2024-09-18T00:33:11.777680+0000","last_fullsized":"2024-09-18T00:33:11.777680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:13:31.947275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015283199999999999,"stat_sum":{"num_bytes":46225166,"num_objects":54,"num_object_clones":19,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":16,"num_read":5569,"num_read_kb":35972,"num_write":720,"num_write_kb":24000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"3.11","version":"95'1184","reported_seq":5419,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.300927+0000","last_change":"2024-09-18T00:33:09.300927+0000","last_active":"2024-09-18T00:33:09.300927+0000","last_peered":"2024-09-18T00:33:09.300927+0000","last_clean":"2024-09-18T00:33:09.300927+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:33:09.300927+0000","last_undegraded":"2024-09-18T00:33:09.300927+0000","last_fullsized":"2024-09-18T00:33:09.300927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1184,"log_dups_size":0,"ondisk_log_size":1184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:25.653274+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.012234060999999999,"stat_sum":{"num_bytes":50403015,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":19,"num_read":11890,"num_read_kb":30831,"num_write":1748,"num_write_kb":11121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"5"}]},{"pgid":"3.12","version":"97'488","reported_seq":6822,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-18T00:33:11.778392+0000","last_change":"2024-09-18T00:33:11.778778+0000","last_active":"2024-09-18T00:33:11.778392+0000","last_peered":"2024-09-18T00:33:11.778392+0000","last_clean":"2024-09-18T00:33:11.778392+0000","last_became_active":"2024-09-18T00:31:46.858545+0000","last_became_peered":"2024-09-18T00:31:46.858545+0000","last_unstale":"2024-09-18T00:33:11.778392+0000","last_undegraded":"2024-09-18T00:33:11.778392+0000","last_fullsized":"2024-09-18T00:33:11.778392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:56:37.551035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001589409,"stat_sum":{"num_bytes":86010122,"num_objects":59,"num_object_clones":15,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":7520,"num_read_kb":71356,"num_write":467,"num_write_kb":29004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2d","length":"6"}]},{"pgid":"3.13","version":"95'660","reported_seq":3703,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-18T00:33:09.391091+0000","last_change":"2024-09-18T00:33:09.290343+0000","last_active":"2024-09-18T00:33:09.391091+0000","last_peered":"2024-09-18T00:33:09.391091+0000","last_clean":"2024-09-18T00:33:09.391091+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:33:09.391091+0000","last_undegraded":"2024-09-18T00:33:09.391091+0000","last_fullsized":"2024-09-18T00:33:09.391091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:27:50.336794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016562809999999999,"stat_sum":{"num_bytes":40318226,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":13,"num_read":4886,"num_read_kb":25973,"num_write":840,"num_write_kb":18260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1747750793,"num_objects":1816,"num_object_clones":489,"num_object_copies":3632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1816,"num_whiteouts":562,"num_read":206148,"num_read_kb":1000801,"num_write":20406,"num_write_kb":484780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59998208,"data_stored":690344559,"data_compressed":17797630,"data_compressed_allocated":47968256,"data_compressed_original":683391049,"omap_allocated":0,"internal_metadata":0},"log_size":17195,"ondisk_log_size":17195,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59756,"kb_used_data":10516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312084,"statfs":{"total":96636764160,"available":96575574016,"internally_reserved":0,"allocated":10768384,"data_stored":115113262,"data_compressed":3058275,"data_compressed_allocated":7663616,"data_compressed_original":113359362,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39560,"kb_used_data":4216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332280,"statfs":{"total":96636764160,"available":96596254720,"internally_reserved":0,"allocated":4317184,"data_stored":42832459,"data_compressed":583343,"data_compressed_allocated":2732032,"data_compressed_original":42057714,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59416,"kb_used_data":10180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312424,"statfs":{"total":96636764160,"available":96575922176,"internally_reserved":0,"allocated":10424320,"data_stored":106273740,"data_compressed":2826677,"data_compressed_allocated":7544832,"data_compressed_original":104774487,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84540,"kb_used_data":13088,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94287300,"statfs":{"total":96636764160,"available":96550195200,"internally_reserved":0,"allocated":13402112,"data_stored":150295542,"data_compressed":3676581,"data_compressed_allocated":9596928,"data_compressed_original":148188248,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45688,"kb_used_data":6176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326152,"statfs":{"total":96636764160,"available":96589979648,"internally_reserved":0,"allocated":6324224,"data_stored":58120515,"data_compressed":1661904,"data_compressed_allocated":4112384,"data_compressed_original":56972199,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58008,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313832,"statfs":{"total":96636764160,"available":96577363968,"internally_reserved":0,"allocated":8962048,"data_stored":73938222,"data_compressed":2268292,"data_compressed_allocated":6131712,"data_compressed_original":72477425,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38504,"kb_used_data":3152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333336,"statfs":{"total":96636764160,"available":96597336064,"internally_reserved":0,"allocated":3227648,"data_stored":14916944,"data_compressed":876661,"data_compressed_allocated":1486848,"data_compressed_original":14047232,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61468,"kb_used_data":12228,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94310372,"statfs":{"total":96636764160,"available":96573820928,"internally_reserved":0,"allocated":12521472,"data_stored":142717275,"data_compressed":3044000,"data_compressed_allocated":9408512,"data_compressed_original":141035077,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10842112,"data_stored":136598892,"data_compressed":2926910,"data_compressed_allocated":8990720,"data_compressed_original":135532558,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5185536,"data_stored":57402673,"data_compressed":1654816,"data_compressed_allocated":4096000,"data_compressed_original":56775591,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2019328,"data_stored":14184441,"data_compressed":876430,"data_compressed_allocated":1466368,"data_compressed_original":13871104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7688192,"data_stored":72147619,"data_compressed":2234555,"data_compressed_allocated":6037504,"data_compressed_original":71240433,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12283904,"data_stored":149774327,"data_compressed":3676581,"data_compressed_allocated":9596928,"data_compressed_original":148188248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9302016,"data_stored":105752506,"data_compressed":2826677,"data_compressed_allocated":7544832,"data_compressed_original":104774487,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3198976,"data_stored":42311244,"data_compressed":583343,"data_compressed_allocated":2732032,"data_compressed_original":42057714,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9478144,"data_stored":112172857,"data_compressed":3018318,"data_compressed_allocated":7503872,"data_compressed_original":110950914,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:33:15.240 INFO:tasks.thrashosds.thrasher:Setting 3.10 to [1, 4] 2024-09-18T00:33:15.240 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.10', '1', '4'] 2024-09-18T00:33:15.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.10 1 4 2024-09-18T00:33:15.321 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:15.319+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:15.329 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.329 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:15.422 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:15.420+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:15.484 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.484 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.491 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:15.489+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:15.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:15.592 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:15.590+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:15.637 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:15.692 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:15.690+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:15.749 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.749 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:15.783 INFO:teuthology.orchestra.run.smithi081.stderr:set 3.10 pg_upmap mapping to [1,4] 2024-09-18T00:33:15.789 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:33:15.793 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:15.790+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:15.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:15.903 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:15.901+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:15.904 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:15.904 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:15.914 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:15.994 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:15.993+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:15.997 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:16.014 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:16.021 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:16.021 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:16.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:16.031 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:16.031 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:16.046 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:16.063 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:16.063 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:16.079 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:16.096 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:16.113 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:16.114 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:16.113+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:16.173 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:16.174 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:16.174 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:16.174 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:16.174 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:16.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:16.228 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:16.226+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:16.297 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:16.295+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183824854999997, 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.331 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:16.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183804391999999, 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.336 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:16.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.340 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183784997000004, 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:16.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183765842, 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:16.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:16.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:16.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:16.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183746412000005, 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:16.351 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:16.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:16.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.355 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183726757000002, 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:16.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:16.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183707763000001, 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:16.360 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:16.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.364 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183668838000003, 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.365 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:16.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.369 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183648758000004, 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.370 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.371 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183629014000005, 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.374 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:16.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:16.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:16.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:16.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.380 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183609235000006, 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.381 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:16.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:16.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183589647000005, 2024-09-18T00:33:16.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:16.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:16.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183560181000004, 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:16.392 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:16.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:16.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183529848000006, 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:16.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183503118000004, 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183475720999994, 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183450078000007, 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183425172, 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:16.415 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:16.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:16.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.419 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183391001000004, 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.420 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:16.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:16.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:16.424 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.183353081000007, 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:16.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:16.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.430 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:16.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:16.432 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:16.429+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:16.532 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:16.530+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:16.576 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:16.576 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:16.576 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:16.576 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:16.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:16.633 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:16.632+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:16.687 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:16.687 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:16.687 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:16.687 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:16.687 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:16.696 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:16.736 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:16.735+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:16.835 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:16.833+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:16.852 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.049248801999994, 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.853 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:16.854 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.855 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.047318359000002, 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:33:16.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.859 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:33:16.861 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:16.862 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.047300019000005, 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:33:16.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.864 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:33:16.865 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.866 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.867 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.045709298000006, 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.868 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:16.869 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.870 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.871 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.872 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.045666065000006, 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.873 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:33:16.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.876 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.045467918, 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:33:16.878 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.879 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:33:16.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.882 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.045313526000001, 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:33:16.884 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.885 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.886 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.045099781000005, 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.887 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.888 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.889 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.891 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.044901386000006, 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.892 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:33:16.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:33:16.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:33:16.895 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.044540538000007, 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.896 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.897 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.900 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.041259539999999, 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:33:16.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:33:16.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.041240364999993, 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.905 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:16.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.039381261000003, 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:33:16.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.039356364, 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.914 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:16.915 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.918 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.039335859000005, 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.919 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:33:16.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.039317104999995, 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.923 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.924 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.927 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.037296823999995, 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.928 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.037278237999999, 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.933 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:33:16.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:33:16.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.036442324999996, 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.937 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 84.031267158999995, 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:16.941 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:33:16.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:16.945 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:16.946 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:16.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:16.947 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:16.945+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:17.048 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:17.046+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:17.092 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:17.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:17.092 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:17.092 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:17.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:17.184 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:17.183+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:17.243 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:17.243 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:17.243 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:17.243 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:17.244 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:17.250 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:17.248+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:17.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:17.350 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:17.349+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.037600681000001, 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.398 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:17.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.032252143999997, 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.403 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:33:17.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.028512418999995, 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.407 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:17.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.028488050999997, 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:17.413 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:17.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.417 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.028475470999993, 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:17.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:17.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.028465194999995, 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.422 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:17.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.426 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.016611010999995, 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.427 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:17.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.429 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.430 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.016590640999993, 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:17.431 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:17.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:17.435 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.014631003999995, 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.436 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:17.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:17.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.014621735000006, 2024-09-18T00:33:17.440 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:17.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:17.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.012608434000001, 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.445 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:17.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:17.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.448 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.012590273000001, 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.449 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:17.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:17.453 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.010292390000004, 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:17.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.457 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.010251940000003, 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:17.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:17.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.010156444000003, 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.462 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:17.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.466 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.008580718999994, 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:17.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.008560001000006, 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.471 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:17.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.008536468000003, 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.476 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:17.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:17.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.008513870000002, 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.480 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:17.484 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 85.006558312999999, 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:17.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:17.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.490 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:17.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:17.492 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:17.490+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:17.592 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:17.591+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:17.635 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:17.635 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:17.636 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:17.636 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:17.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:17.693 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:17.691+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:17.794 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:17.791+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:17.795 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:17.795 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:17.795 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:17.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:17.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:33:17.894 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:17.893+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:17.919 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.329790883000001, 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.329725698000001, 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.931 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.329608788000002, 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.932 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:17.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.327897976999999, 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:17.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:17.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:17.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.325750425999999, 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:17.943 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:17.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:17.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.323966374000001, 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.948 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:17.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.323930338, 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:17.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.323920143999999, 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.957 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:17.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.961 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.323910300000001, 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:17.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321797864000001, 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.966 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:17.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:17.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.971 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321704095000001, 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.972 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:17.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:17.976 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321683405999998, 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:17.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.980 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321664621, 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.981 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:17.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321590551, 2024-09-18T00:33:17.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.989 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321571098, 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.990 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:17.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:17.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321551734, 2024-09-18T00:33:17.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:17.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:17.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.998 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321377685000002, 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:17.999 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.321347320000001, 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:18.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.007 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.319900452999999, 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:18.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:18.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 27.319874993999999, 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:18.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:18.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:18.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:18.016 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:18.018 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:18.016+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:18.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:18.119 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:18.118+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:18.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:18.131 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:18.131 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:18.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:18.228 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:18.223+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:18.248 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:18.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:18.265 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:18.282 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:18.288 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:18.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:18.298 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:18.299 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:18.316 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:18.320 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:18.318+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:18.334 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:18.334 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:18.350 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:18.351 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:18.368 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:18.404 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:18.404 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:18.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:18.454 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:18.452+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:18.523 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:18.521+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:18.556 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:18.556 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:18.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:18.624 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:18.622+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:18.667 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:18.667 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:18.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:18.725 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:18.724+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:18.780 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:18.780 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:18.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:33:18.851 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:18.849+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:18.905 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:18.905 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:18.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:18.955 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:18.953+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:19.027 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:19.025+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:19.058 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.058 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:19.150 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:19.148+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:19.210 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.210 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:19.260 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:19.258+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:19.330 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:19.328+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:19.361 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.361 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:19.454 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:19.451+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:19.512 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.512 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:19.533 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:19.532+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:19.633 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:19.631+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:19.663 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.663 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:19.734 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:19.733+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:19.789 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.789 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:19.842 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:19.841+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:19.937 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:19.936+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:19.947 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:19.948 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:19.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:20.042 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:20.040+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:20.101 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:20.101 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:20.109 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:20.151 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:20.149+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:20.239 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:20.237+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:20.254 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:20.254 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:20.263 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:20.340 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:20.338+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:20.366 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:20.367 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:20.375 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:20.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:20.441 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:20.438+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:20.501 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:20.518 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:20.519 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:20.520 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:20.528 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:20.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:20.534 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:20.550 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:20.566 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:20.567 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:20.572 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:20.571+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:20.583 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:20.583 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:20.599 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:20.615 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:20.634 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:20.634 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:20.634 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:20.634 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:20.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:20.643 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:20.641+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:20.744 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:20.742+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:20.786 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:20.787 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:20.787 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:20.787 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:20.787 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:20.796 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:20.805 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:20.806 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:20.806 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:33:20.806 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 1.000000 2024-09-18T00:33:20.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-18T00:33:20.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:33:20.851 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:20.849+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:20.945 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:20.944+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:20.952 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:20.952 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.592402324999995, 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.953 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:20.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1797 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.587053788000006, 2024-09-18T00:33:20.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045975104000000003, 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1797 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.363409+0000", 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364884+0000", 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014746449999999999 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364888+0000", 2024-09-18T00:33:20.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-06 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364896+0000", 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5220000000000007e-06 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.364903+0000", 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2829999999999998e-06 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409281+0000", 2024-09-18T00:33:20.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044378332 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409324+0000", 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2873000000000001e-05 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.409384+0000", 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0448999999999997e-05 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.583314063000003, 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.962 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:20.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:20.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:20.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.583289695000005, 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.966 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:20.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:20.970 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.583277115000001, 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.972 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.974 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.583266839000004, 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.975 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.571412655000003, 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.979 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.981 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:20.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.571392285000002, 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:20.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:20.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:20.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.569432648000003, 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:20.988 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.992 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.569423379, 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:20.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:20.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.567410077999995, 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:20.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:20.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:20.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.567391916999995, 2024-09-18T00:33:21.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:21.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:21.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.565094033999998, 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.006 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:21.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.565053583999997, 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.010 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.014 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.564958087999997, 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:21.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.563382363000002, 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:21.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:21.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:21.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.563361645000001, 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.023 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.563338111999997, 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.027 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:21.031 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.563315513999996, 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:21.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:21.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 88.561359956999993, 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:21.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.041 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:21.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:21.084 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:21.082+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:21.146 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:21.145+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:21.187 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:21.187 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:21.187 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:21.187 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:21.195 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:21.248 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:21.246+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:21.300 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:21.300 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:21.300 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:21.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:21.348 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:21.347+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:21.449 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:21.448+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:21.450 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.861360226999999, 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.451 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.454 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.455 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.861295041999998, 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.456 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:21.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:21.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.861178131999999, 2024-09-18T00:33:21.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:21.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.859467321, 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.466 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:21.467 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.85731977, 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.470 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.855535717999999, 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.475 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:21.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.855499682000001, 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:21.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:21.483 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.855489488, 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.484 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.855479643999999, 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853367208000002, 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853273438999999, 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:21.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853252749999999, 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:21.502 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.503 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:21.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:21.507 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853233965000001, 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:21.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:21.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853159895000001, 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:21.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:21.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:21.516 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.517 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853140442000001, 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.853121078000001, 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.522 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:21.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.526 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.852947028999999, 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.527 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:21.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.531 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.852916663999999, 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.532 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:21.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.851469797, 2024-09-18T00:33:21.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:21.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:21.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 30.851444338, 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:21.541 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:21.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:21.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:21.545 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:21.546 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:21.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:21.550 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:21.548+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:21.651 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:21.651 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:21.651 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:21.651 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:21.652 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:21.650+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:21.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:21.752 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:21.751+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:21.772 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-18T00:33:21.772 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:33:21.818 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:21.818 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:21.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:21.869 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:21.867+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:21.954 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:21.953+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:21.972 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:21.972 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:21.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:21.972 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:21.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.448776318999997, 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:21.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:21.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:21.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.437051101000002, 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:21.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:21.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.436757804999999, 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:21.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:21.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.436615637999999, 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.436314027000002, 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.430844530999998, 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.430823971000002, 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:22.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.430803478999998, 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:22.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:22.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.430784031999998, 2024-09-18T00:33:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429960713, 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429941757000002, 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:22.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429908038000001, 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.024 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:22.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429884577000003, 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429864657000003, 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:22.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429845659000001, 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:22.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429063094, 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:22.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429032429999999, 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.429010769999998, 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:22.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.428990335000002, 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.426959699000001, 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.060 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:22.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.064 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:22.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:22.066 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:22.064+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:22.167 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:22.165+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:22.209 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:22.210 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:22.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:22.267 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:22.266+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:22.362 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:22.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:22.362 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:22.369 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:22.367+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:22.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:22.470 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:22.468+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.045043407999998, 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.520 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044752693000007, 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:22.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044706234000003, 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044682738000006, 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044660233000002, 2024-09-18T00:33:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044150282999993, 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044100194999999, 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044068824999997, 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044046738000006, 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.044024699999994, 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:22.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:22.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042862678000006, 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.561 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:22.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:22.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042831358000001, 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042799561999999, 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042774451, 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042730984000002, 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.582 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042709096999999, 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:22.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.042651819, 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:22.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:22.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:22.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:22.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:22.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.04262473, 2024-09-18T00:33:22.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:22.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:22.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.711994691999998, 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:22.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.711975664000001, 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:22.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:22.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:22.605 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:22.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:22.607 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:22.605+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:22.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:22.707 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:22.706+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:22.754 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:22.755 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:22.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:22.770 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:22.770 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:22.807 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:22.806+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:22.813 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:22.813 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:22.834 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:22.851 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:22.870 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:22.880 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:22.880 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:22.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:22.904 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:22.904 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:22.916 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:22.914+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:23.007 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.008 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.010 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:23.008+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:23.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:23.111 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:23.110+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:23.159 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.159 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:23.213 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:23.212+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:23.312 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.312 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.313 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:23.311+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:23.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:23.413 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:23.412+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:23.463 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.464 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:23.514 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:23.513+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:23.590 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.590 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.599 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:23.645 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:23.644+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:23.705 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.705 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:23.716 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:23.714+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:23.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:33:23.839 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:23.838+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:23.891 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:23.891 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:23.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:23.946 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:23.945+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:24.018 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:24.016+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:24.020 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.020 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:24.118 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:24.117+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:24.173 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.174 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.182 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:24.223 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:24.222+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:24.320 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:24.319+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:24.326 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.326 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.334 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:24.422 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:24.420+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:24.437 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.438 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:24.522 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:24.520+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:24.550 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.551 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.559 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:24.622 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:24.621+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:24.703 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.703 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.712 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:24.755 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:24.754+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:24.816 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.816 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:33:24.824 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:24.823+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:24.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:24.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:24.924 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:24.923+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:24.971 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:24.971 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:24.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:25.043 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:25.043 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:25.059 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:25.060 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:25.064 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:25.063+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:25.075 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:25.091 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:25.092 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:25.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:25.124 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:25.124 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:25.125 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:25.125 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:25.127 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:25.126+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:25.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:25.141 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:25.159 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:25.160 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:25.228 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:25.226+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:25.238 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:25.238 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:25.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:25.329 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:25.328+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:25.390 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:25.390 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:25.390 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:25.390 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:25.390 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:25.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:25.430 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:25.429+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:25.503 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:25.504 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.979246275000001, 2024-09-18T00:33:25.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:25.505 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:25.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.510 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.967521056999999, 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:25.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:25.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:25.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:25.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:25.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:25.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:25.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:25.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.967227760999997, 2024-09-18T00:33:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:25.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:25.525 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.967085593999997, 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:25.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.966783982999999, 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:25.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:25.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:25.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.961314487000003, 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:25.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:25.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.961293927, 2024-09-18T00:33:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.961273435000003, 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:25.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:25.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.961253988000003, 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:25.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.960430668999997, 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:25.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:25.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.960411712999999, 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.960377993999998, 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.960354533, 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.574 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:25.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:25.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:25.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.960334613000001, 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:25.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:25.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.960315614999999, 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.959533049999997, 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:25.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:25.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.959502385999997, 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.959480726000002, 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:25.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.959460290999999, 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:25.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:25.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:25.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.611 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:25.611 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:25.611 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 44.957429654999999, 2024-09-18T00:33:25.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:25.611 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:25.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:25.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:25.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:25.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:25.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:25.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:25.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:25.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:25.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:25.618 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:25.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:25.620 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:25.617+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:25.719 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:25.718+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:25.763 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:25.763 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:25.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:25.856 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:25.855+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:25.921 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:25.919+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:25.924 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:25.924 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:25.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:26.022 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:26.020+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:26.077 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.606934143999993, 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:26.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.083 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:26.083 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.606643429000002, 2024-09-18T00:33:26.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:26.084 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:26.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:26.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:26.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:26.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.606596969999998, 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.606573474000001, 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:26.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.606550968999997, 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.107 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.606041019000003, 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:26.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:26.113 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.605990930999994, 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:26.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:26.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:26.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:26.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:26.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:26.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.120 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.605959561000006, 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.122 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.122 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:26.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.122 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:26.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:26.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:26.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:26.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:26.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:26.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:26.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:26.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:26.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:26.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.605937474000001, 2024-09-18T00:33:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:26.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.133 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:26.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:26.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.605915436000004, 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604753414000001, 2024-09-18T00:33:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604722093999996, 2024-09-18T00:33:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604690297999994, 2024-09-18T00:33:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604665186999995, 2024-09-18T00:33:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604621719999997, 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604599832999995, 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604542554999995, 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.604515465999995, 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.273885428, 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.273866400000003, 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.217 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:26.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:26.219 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:26.217+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:26.320 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:26.318+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:26.362 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:26.362 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:26.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:26.420 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:26.419+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:26.513 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:26.513 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:26.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:26.523 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:26.520+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:26.622 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:26.621+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:26.667 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:26.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.129856441000001, 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:26.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.985469984999995, 2024-09-18T00:33:26.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:26.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.960153156000004, 2024-09-18T00:33:26.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:26.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.836288737000004, 2024-09-18T00:33:26.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:33:26.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:33:26.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:33:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.757580051000005, 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.757423766000002, 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:26.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:26.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.757239441999999, 2024-09-18T00:33:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:26.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:26.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.639121089, 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:26.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.480947666999995, 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.711 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:26.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:26.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.479969733000004, 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:26.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.479243120999996, 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:26.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.595396355999995, 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:26.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.594354465999999, 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:26.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:26.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.589329778999996, 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:26.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:26.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.050111994999995, 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:26.740 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:26.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.620487500999999, 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:26.745 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:26.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:26.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.420242649999999, 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:26.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:26.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:26.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:26.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:26.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:26.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:26.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:26.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:26.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:33:26.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:26.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.352584239999999, 2024-09-18T00:33:26.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:33:26.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:33:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:33:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:33:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:33:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:33:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.318281427999999, 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.317518857000003, 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:33:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:26.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:26.780 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:26.778+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:26.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:26.795 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:26.795 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:26.796 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-18T00:33:26.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-18T00:33:26.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:33:26.909 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:26.908+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:26.938 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:26.939 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:26.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:26.975 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:26.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:26.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-18T00:33:27.016 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:27.014+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:27.080 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:27.080 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:27.080 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:27.080 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:27.080 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:27.081 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:27.080+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:27.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:27.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:27.182 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:27.181+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:27.185 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:27.186 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:27.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-18T00:33:27.238 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.266435498000007, 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.266055840999996, 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.265226658000003, 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:33:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:33:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.258442055000003, 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.258421588999994, 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.258397500000001, 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.256551537999997, 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.269 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.256487719000006, 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.256458839000004, 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.275 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:27.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.256433862999998, 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.283 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.256414810999999, 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:27.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:27.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.254466014000002, 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:27.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:27.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.254443557000002, 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:27.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.254415116999994, 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.254392808999995, 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.305 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.254372356999994, 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:27.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:27.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.253542908, 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:27.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.253501983000007, 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:27.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.253460735999994, 2024-09-18T00:33:27.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.253438071000005, 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:27.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:27.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:27.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:27.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:27.328 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:27.330 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:27.331 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:27.331 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:27.332 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:27.328+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:27.332 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:27.367 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:27.367 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:27.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-18T00:33:27.368 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:27.383 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:27.400 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:27.417 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:27.430 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:27.428+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:27.441 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:27.441 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:27.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:27.515 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:27.515 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:27.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:27.519 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:27.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-18T00:33:27.562 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:27.561+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:27.593 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:27.594 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:27.602 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:27.646 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:27.645+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:27.652 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:27.652 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:27.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-18T00:33:27.705 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:27.705 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:27.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:27.754 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:27.753+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:33:27.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:27.827 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:27.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-18T00:33:27.850 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:27.844+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:27.864 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:27.864 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:27.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:27.934 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:27.933+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:27.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:27.979 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:27.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-18T00:33:27.986 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:27.986 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:27.995 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:28.065 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:28.063+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:28.098 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.098 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:28.137 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:28.135+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:28.210 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.210 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.218 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:28.262 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:28.261+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:28.322 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.322 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-18T00:33:28.323+0000 7fa3677fe640 0 --2- 172.21.15.81:0/2734171470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa36813c5a0 0x7fa368141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-18T00:33:28.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:no valid command found; 10 closest matches: 2024-09-18T00:33:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:0 2024-09-18T00:33:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:1 2024-09-18T00:33:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2 2024-09-18T00:33:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:abort 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:assert 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:bench [] [] [] [] 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs debug_inject_read_zeros 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs files list 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:bluefs stats 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:bluestore allocator dump block 2024-09-18T00:33:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-18T00:33:28.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:28.355 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-18T00:33:28.373 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:28.371+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:28.440 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:28.438+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:28.474 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.474 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.483 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:28.541 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:28.539+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:28.586 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.586 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:28.642 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:28.640+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:28.697 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.697 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:28.742 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:28.741+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:28.810 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.810 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:28.843 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:28.841+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:28.933 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:28.934 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:28.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:28.945 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:28.943+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:29.046 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:29.045+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:29.047 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:29.047 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:29.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:29.148 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:29.146+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:29.160 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:29.160 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:29.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:29.248 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:29.247+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:29.313 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:29.313 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:29.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:29.365 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:29.364+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:29.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:29.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:29.474 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:29.472+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:29.551 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:29.552 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:29.552 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:29.550+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:29.569 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:29.569 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.110137288999994, 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109846574000002, 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109800114999999, 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109776619000002, 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109754113999998, 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109244164000003, 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109194075999994, 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109162706000006, 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109140619000001, 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.109118581000004, 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107956559000002, 2024-09-18T00:33:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107925238999997, 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107893442999995, 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107868331999995, 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107824864999998, 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107802977999995, 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107745699999995, 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.107718610999996, 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.777088573, 2024-09-18T00:33:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.777069545000003, 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:29.677 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:29.678 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:29.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:29.680 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:29.680 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:29.680 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:29.680 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:29.681 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:29.681 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:29.682 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:29.683 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:29.677+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:29.779 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:29.778+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:29.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:29.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:33:29.881 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:29.879+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:29.948 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:29.948 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:29.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:30.001 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:30.000+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:30.082 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:30.080+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:30.091 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.553799579, 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.409413122999993, 2024-09-18T00:33:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.384096294000003, 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.260231875000002, 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:33:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:33:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:33:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.181523189000004, 2024-09-18T00:33:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.181366904000001, 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.181182579999998, 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.063064226999998, 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 81.904890804999994, 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 81.903912871000003, 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 81.903186258999995, 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.019339493999993, 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.018297603999997, 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.013272916999995, 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.474055132999993, 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 69.044430638999998, 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.844185787999997, 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.776527377999997, 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:33:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:33:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.742224565999997, 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.741461995000002, 2024-09-18T00:33:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:33:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:33:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.192 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:30.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:30.194 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:30.192+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:30.294 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:30.293+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:30.337 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:30.337 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:30.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:30.395 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:30.394+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:30.489 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:30.490 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:30.496 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:30.495+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:30.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:30.597 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:30.596+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:30.602 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.633518959, 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.633139302000004, 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5088 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.632310118999996, 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054271724, 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5088 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968333+0000", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968881+0000", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054762500000000004 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968885+0000", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1180000000000002e-06 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968892+0000", 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9609999999999999e-06 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968898+0000", 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022486+0000", 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053588304000000003 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022555+0000", 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999998e-05 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.022605+0000", 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0507000000000003e-05 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.625525515999996, 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.625505050000001, 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.625480960999994, 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.623634999000004, 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.623571179999999, 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.623542299999997, 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.623517324000005, 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.623498272000006, 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.621549474999995, 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.621527017999995, 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.621498578000001, 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.621476270000002, 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.621455818000001, 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.620626369000007, 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.620585444, 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.620544197000001, 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.620521531999998, 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:30.705 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:30.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:30.708 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:30.705+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:30.808 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:30.807+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:30.823 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:30.823 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:30.823 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:30.823 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:30.832 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:33:30.912 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:30.911+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:30.945 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:30.946 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:30.946 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:30.946 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:30.946 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:30.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:31.011 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:31.009+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:31.060 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913610272, 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:31.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:31.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:31.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913589809000001, 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.066 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913570414000006, 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.071 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:31.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913551259000002, 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:31.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913531828999993, 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913512174000005, 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913493180000003, 2024-09-18T00:33:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913454255000005, 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913434175000006, 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913414431000007, 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913394651999994, 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913375063999993, 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.117 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913345598000006, 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913315264999994, 2024-09-18T00:33:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913288535000007, 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913261137999996, 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913235494999995, 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913210589000002, 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913176418000006, 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.150 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:31.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.154 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 78.913138497999995, 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:31.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:31.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:31.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.160 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:31.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:31.162 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:31.159+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:31.262 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:31.260+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:31.265 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:31.265 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:31.265 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:31.265 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:31.275 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:31.363 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:31.361+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:31.379 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:31.379 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:31.379 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:31.379 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:31.379 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:31.387 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:31.464 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:31.462+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:31.492 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.689123100000003, 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:33:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.687192656999997, 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:33:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.687174317, 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:33:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:33:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.506 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.685583596000001, 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:33:31.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:33:31.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:33:31.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:33:31.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.512 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.512 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.513 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:31.513 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.685540363000001, 2024-09-18T00:33:31.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:33:31.513 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.513 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.513 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:33:31.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:33:31.517 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.685342215999995, 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.518 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:31.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:33:31.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.685187823999996, 2024-09-18T00:33:31.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:33:31.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:33:31.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.527 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.684974079, 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.528 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:33:31.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.529 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:31.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:31.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:33:31.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.684775684000002, 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:33:31.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:33:31.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.684414836000002, 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.541 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:33:31.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.545 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.681133837999994, 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:33:31.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:33:31.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.681114663000002, 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.550 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:31.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:33:31.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:33:31.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.679255558999998, 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.556 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:31.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:33:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.679230661999995, 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.564 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:33:31.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:33:31.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:33:31.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:33:31.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:33:31.571 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.571 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.571 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.571 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.679210157, 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.572 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:31.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:33:31.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:33:31.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.679191403000004, 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.579 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:33:31.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:33:31.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.677171122000004, 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.584 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:33:31.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:33:31.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.589 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.677152535999994, 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.590 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:33:31.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.676316623000005, 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.594 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:33:31.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:33:31.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 98.671141457000004, 2024-09-18T00:33:31.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:31.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:31.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:33:31.603 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.604 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.604 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.604 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:31.604 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:31.604 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:31.605 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:31.606 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:31.604+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:31.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:31.730 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:31.728+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:31.749 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:31.749 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:31.758 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:31.808 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:31.806+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:31.813 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:31.813 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:31.832 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:31.832 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:31.849 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:31.849 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:31.871 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:31.873 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:31.873 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:31.873 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:31.883 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:31.889 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:31.907 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:31.908 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:31.907+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:31.924 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:31.924 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:31.941 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:31.997 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:32.042 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:32.040+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:32.112 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:32.110+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:32.212 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:32.211+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.264 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:32.314 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:32.312+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:32.420 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:32.419+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:32.481 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.481 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:32.516 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:32.515+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:32.617 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:32.616+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:32.634 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.634 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:32.718 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:32.716+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:32.745 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.745 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:32.839 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:32.838+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:32.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:33:32.909 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:32.909 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:32.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:32.920 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:32.918+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:33.020 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:33.019+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:33.067 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.068 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:33.161 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:33.160+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:33.222 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.222 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.223 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:33.221+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:33.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:33.323 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:33.322+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:33.356 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:33.356 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:33.356 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-18T00:33:33.356 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T00:33:33.357 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T00:33:33.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-18T00:33:33.373 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.373 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:33.424 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:33.422+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:33.464 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T00:33:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:33.524 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:33.523+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:33.526 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.526 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:33.625 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:33.624+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:33.637 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.637 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:33.729 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:33.728+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:33.788 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.788 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:33.828 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:33.827+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:33.870 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:33:33.929 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:33.928+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:33.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:33.953 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:33.954 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:33.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:34.046 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:34.045+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:34.078 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:34.095 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:34.109 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:34.109 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:34.111 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:34.112 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:34.118 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:34.128 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:34.131 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:34.130+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:34.145 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:34.161 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:34.161 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:34.177 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:34.223 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:34.223 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:34.232 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:34.232 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:34.230+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:34.333 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:34.331+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:34.377 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:34.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:34.395 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:34.447 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:34.446+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382696189000001, 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.530 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382675726000002, 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.535 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:34.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382656331000007, 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.544 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382637176000003, 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.545 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.549 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382617745999994, 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:34.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:34.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382598091000006, 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:34.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382579097000004, 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:34.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382540172000006, 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:34.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382520091999993, 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.568 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.569 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:34.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:34.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382500347999994, 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.573 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:34.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:34.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382480568999995, 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.578 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:34.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:34.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.581 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382460980999994, 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.582 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:34.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382431514999993, 2024-09-18T00:33:34.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.590 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382401181999995, 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:34.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382374451999993, 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.595 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.599 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382347054999997, 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:34.603 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382321411999996, 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.604 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.608 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.608 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:34.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.611 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382296506000003, 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:34.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.615 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382262334999993, 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.616 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:34.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:34.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:34.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 82.382224414999996, 2024-09-18T00:33:34.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:34.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:34.627 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:34.624+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:34.727 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:34.725+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:34.730 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:34.730 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:34.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:34.828 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:34.826+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:34.843 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:34.843 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:34.843 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:34.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:34.936 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:34.935+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4025 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 43008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.201135561, 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049154679, 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4025 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.801195+0000", 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802880+0000", 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001685052 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802884+0000", 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5559999999999999e-06 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802893+0000", 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6710000000000005e-06 2024-09-18T00:33:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.802899+0000", 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1430000000000003e-06 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850128+0000", 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047229465999999998 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850233+0000", 2024-09-18T00:33:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000105226 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.850350+0000", 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00011656500000000001 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4035 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19920511799999, 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049110565000000002, 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4035 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803126+0000", 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803128+0000", 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9740000000000001e-06 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803134+0000", 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.604e-06 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803138+0000", 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6550000000000003e-06 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852057+0000", 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048918793000000002 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852140+0000", 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3268000000000003e-05 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852236+0000", 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5908000000000004e-05 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4036 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.199186778, 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049292010999999997, 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4036 2024-09-18T00:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.803144+0000", 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804573+0000", 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0014288599999999999 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804577+0000", 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9339999999999999e-06 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804587+0000", 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0064000000000001e-05 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.016 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804593+0000", 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4799999999999998e-06 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852266+0000", 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047672630000000001 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852345+0000", 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8561999999999998e-05 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.852436+0000", 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1481e-05 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4043 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.197596057, 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049040602000000003, 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.018 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.019 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4043 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804735+0000", 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804755+0000", 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0667000000000001e-05 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.021 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804758+0000", 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.8310000000000001e-06 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804765+0000", 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8299999999999998e-06 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804770+0000", 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3290000000000001e-06 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853675+0000", 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048904978000000002 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853720+0000", 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4118e-05 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853775+0000", 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5849e-05 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.023 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4044 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.197552824, 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049166096999999999, 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.024 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4044 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804778+0000", 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804950+0000", 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017209300000000001 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804953+0000", 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.2650000000000001e-06 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804961+0000", 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5859999999999999e-06 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.026 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804967+0000", 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0549999999999996e-06 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853794+0000", 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048827331000000002 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853861+0000", 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6952000000000005e-05 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853944+0000", 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2814999999999999e-05 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4045 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19735467700001, 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049087453000000003, 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.028 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4045 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.804976+0000", 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805106+0000", 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00012991399999999999 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805109+0000", 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.858e-06 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.030 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805116+0000", 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805122+0000", 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7379999999999999e-06 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.853971+0000", 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048848875 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854012+0000", 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0952999999999999e-05 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854064+0000", 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1887e-05 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4046 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.032 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19720028499999, 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049114834000000003, 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4046 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805131+0000", 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805312+0000", 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018141399999999999 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805317+0000", 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5580000000000002e-06 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805326+0000", 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.2599999999999994e-06 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805332+0000", 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0839999999999997e-06 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854101+0000", 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048769395 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854172+0000", 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1214e-05 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854245+0000", 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2909000000000003e-05 2024-09-18T00:33:35.036 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4047 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 673792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19698654, 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049020174999999999, 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.037 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4047 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805344+0000", 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805520+0000", 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017523500000000001 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805523+0000", 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5889999999999999e-06 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805530+0000", 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.131e-06 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805534+0000", 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0899999999999998e-06 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854271+0000", 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048736679999999998 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854312+0000", 2024-09-18T00:33:35.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1211999999999998e-05 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854364+0000", 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2237999999999997e-05 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4048 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.196788145, 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049016263999999997, 2024-09-18T00:33:35.041 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4048 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805543+0000", 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805684+0000", 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00014164599999999999 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805689+0000", 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4850000000000003e-06 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805697+0000", 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6720000000000004e-06 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805702+0000", 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.614e-06 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854402+0000", 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048699469000000002 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854483+0000", 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1620999999999997e-05 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854559+0000", 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5757e-05 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.045 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4050 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 759808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.196427297, 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049023711999999997, 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.046 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4050 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.805904+0000", 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806142+0000", 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000238667 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806146+0000", 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1869999999999999e-06 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806153+0000", 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8340000000000001e-06 2024-09-18T00:33:35.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.806159+0000", 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854741+0000", 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048581430000000002 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854823+0000", 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2465000000000004e-05 2024-09-18T00:33:35.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.854927+0000", 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010422899999999999 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4160 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 217088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19314629900001, 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049054770999999997, 2024-09-18T00:33:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4160 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809185+0000", 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8500000000000002e-07 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809187+0000", 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0549999999999998e-06 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809193+0000", 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7289999999999997e-06 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809198+0000", 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0080000000000002e-06 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858074+0000", 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048875967999999999 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858155+0000", 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1707999999999998e-05 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858239+0000", 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3818000000000003e-05 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.054 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4161 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.193127124, 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049257544, 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.055 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4161 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.809204+0000", 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810880+0000", 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001676725 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810885+0000", 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.121e-06 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810894+0000", 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9940000000000006e-06 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.810900+0000", 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3459999999999999e-06 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858285+0000", 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047384711000000003 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858370+0000", 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5334999999999995e-05 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.858461+0000", 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1311999999999996e-05 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.059 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4170 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19126802, 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049001911000000002, 2024-09-18T00:33:35.060 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4170 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811063+0000", 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.062 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811065+0000", 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811071+0000", 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8000000000000004e-06 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811077+0000", 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9020000000000004e-06 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859901+0000", 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048824386999999997 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.859981+0000", 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9777000000000005e-05 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860065+0000", 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3669000000000001e-05 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4171 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.19124312300001, 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049137505999999997, 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.065 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4171 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811088+0000", 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5999999999999999e-07 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811090+0000", 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3140000000000002e-06 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811097+0000", 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1199999999999999e-06 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811102+0000", 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3589999999999999e-06 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860083+0000", 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048981394999999997 2024-09-18T00:33:35.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860156+0000", 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2719000000000006e-05 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860225+0000", 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9139000000000003e-05 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4172 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 532480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.191222618, 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049281789999999999, 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4172 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811108+0000", 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811109+0000", 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7399999999999999e-07 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.071 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811111+0000", 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9630000000000001e-06 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811117+0000", 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1079999999999998e-06 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811121+0000", 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860258+0000", 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049136953999999997 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860312+0000", 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3653000000000003e-05 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860390+0000", 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8096000000000006e-05 2024-09-18T00:33:35.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4173 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 561152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.191203864, 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049425787999999998, 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.074 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4173 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.811127+0000", 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812899+0000", 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017721119999999999 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812903+0000", 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5159999999999999e-06 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812912+0000", 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9900000000000003e-06 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.812918+0000", 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3570000000000003e-06 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860412+0000", 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047494098999999998 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860473+0000", 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0996999999999999e-05 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.860553+0000", 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9716999999999996e-05 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.078 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4184 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 876544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.189183583, 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049074154000000002, 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4184 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813147+0000", 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813148+0000", 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.82e-07 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813150+0000", 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.951e-06 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813155+0000", 2024-09-18T00:33:35.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6640000000000003e-06 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813160+0000", 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5530000000000003e-06 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862125+0000", 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048964753 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862167+0000", 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2753000000000002e-05 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862221+0000", 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3998e-05 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4185 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 905216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.18916499700001, 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049201453999999999, 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4185 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813166+0000", 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813765+0000", 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00059884599999999999 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813767+0000", 2024-09-18T00:33:35.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.385e-06 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813782+0000", 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.449e-05 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.813788+0000", 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4030000000000004e-06 2024-09-18T00:33:35.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862263+0000", 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048475299999999999 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862314+0000", 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0696999999999999e-05 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862367+0000", 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3332999999999999e-05 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4189 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 1019904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.188329084, 2024-09-18T00:33:35.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049021822999999999, 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4189 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814002+0000", 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814179+0000", 2024-09-18T00:33:35.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00017696199999999999 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814182+0000", 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.072e-06 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814194+0000", 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1729000000000001e-05 2024-09-18T00:33:35.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.814200+0000", 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3339999999999998e-06 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862855+0000", 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048655313999999998 2024-09-18T00:33:35.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.862915+0000", 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9571999999999998e-05 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.863024+0000", 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010883999999999999 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.094 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:4309 3.5 3:a1cde742:::rbd_data.1197ce767b07.0000000000000004:4 [read 792576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 102.183153918, 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049167294, 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.095 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 4309 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.819177+0000", 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820880+0000", 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0017032690000000001 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820884+0000", 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7620000000000001e-06 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820893+0000", 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5609999999999999e-06 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.820899+0000", 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1890000000000004e-06 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868184+0000", 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047284802000000001 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868256+0000", 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2948999999999996e-05 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.868344+0000", 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.7762000000000004e-05 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:35.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:35.101 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:35.099+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:35.201 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:35.200+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.245 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:35.245 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:35.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:35.302 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:35.301+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.357 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:35.357 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:35.357 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:35.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:35.406 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:35.405+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:35.504 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:35.503+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:35.510 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.149952199, 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:35.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:35.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.14086393700001, 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:35.515 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.14083956899999, 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.520 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.524 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.140826989, 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.525 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:35.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:35.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:35.529 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.14081671300001, 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.12896252900001, 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:35.538 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.128942159, 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.542 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.12698252200001, 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.543 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:35.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.547 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.126973253, 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.548 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.549 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.549 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:35.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.549 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:35.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:35.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.124959952, 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.554 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:35.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:35.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.124941791, 2024-09-18T00:33:35.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:35.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.122643908, 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.564 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:35.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:35.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.122603458, 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.122507962, 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.12093223700001, 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.120911519, 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.585 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.586 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.120887986, 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.587 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.588 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:35.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:35.590 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.120865388, 2024-09-18T00:33:35.591 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:35.593 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.594 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.595 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 103.118909831, 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:35.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:35.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:35.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:35.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.600 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:156379 3.a 3:51f6e3de:::rbd_data.1197d85df63.0000000000000022:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:35.601 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 13.656615174000001, 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.93035060199999997, 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 156379 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:35.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851400+0000", 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.945e-06 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851408+0000", 2024-09-18T00:33:35.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2719999999999997e-06 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851428+0000", 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.031e-05 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851438+0000", 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6479999999999998e-06 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851512+0000", 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4019999999999999e-05 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for peered", 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851523+0000", 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.145e-05 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779503+0000", 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.92797969400000002 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.605 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779638+0000", 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00013492800000000001 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779739+0000", 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010061899999999999 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781662+0000", 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001923063 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.606 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781680+0000", 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8848e-05 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781718+0000", 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7240999999999998e-05 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781748+0000", 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0564000000000001e-05 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.607 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.608 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.608 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.608 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:35.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:35.610 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:35.608+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:35.710 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:35.709+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:35.754 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.754 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:35.755 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:35.755 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:35.763 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:35.811 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:35.810+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.865 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:35.865 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:35.866 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:35.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:35.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:33:35.933 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:35.931+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.401073363999998, 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.991 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:35.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:35.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.401008179000002, 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:35.996 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:35.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:35.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.000 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.001 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.400891268999999, 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.002 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:36.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.004 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.005 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.399180458000004, 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.006 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.007 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:36.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:36.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.010 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.011 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.397032907000003, 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.012 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.013 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:36.015 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.395248854999998, 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.016 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:36.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:36.019 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.020 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.395212819000001, 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.021 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.022 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:36.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.395202625000003, 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:36.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.029 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.395192780999999, 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.030 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:36.031 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.032 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.033 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:36.034 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.393080345000001, 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:36.035 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.036 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.037 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:36.038 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392986575999998, 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.039 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:36.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:36.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392965887000003, 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:36.043 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:36.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.046 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.047 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392947102000001, 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:36.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.049 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.051 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.052 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392873031999997, 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.053 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:36.056 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392853578999997, 2024-09-18T00:33:36.057 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:36.059 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392834215000001, 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:36.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.063 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392660165999999, 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.067 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:36.069 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.392629800999998, 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:36.073 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.074 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.391182934, 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.075 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:36.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:36.079 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 45.391157475, 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:36.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.084 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.084 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:36.084 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:36.085 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:36.084+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:36.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:36.186 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:36.185+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:36.190 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:36.190 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:36.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:36.287 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:36.286+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:36.302 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:36.302 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:36.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:36.388 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:36.387+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:36.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.458 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.934234533000001, 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.922509314999999, 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:36.464 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:36.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.922216018999997, 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:36.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.473 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.922073851999997, 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:36.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.921772240999999, 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:36.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.916302745000003, 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.916282185, 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.916261693000003, 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.916242246000003, 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.915418926999997, 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.915399970999999, 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.915366251999998, 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:36.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.915342791, 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.915322871000001, 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.915303872999999, 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.914521307999998, 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.914490643999997, 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.914468984000003, 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.914448548999999, 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.912417912999999, 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:36.554 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:36.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:36.556 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:36.556 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:36.557 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:36.557 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:36.557 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:36.554+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:36.561 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:36.561 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:36.578 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:36.595 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:36.596 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:36.612 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-18T00:33:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T00:33:36.629 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:36.646 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:36.659 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:36.657+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:36.667 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:36.667 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:36.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:36.760 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:36.759+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:33:36.830 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:36.830 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:36.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:36.881 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:36.879+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:36.961 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:36.959+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:36.984 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:36.985 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:36.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:37.062 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:37.061+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:37.137 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.137 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:37.163 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:37.162+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:37.249 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.250 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:37.305 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:37.304+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:37.363 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.363 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.364 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:37.364+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:37.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:37.465 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:33:37.464+0000 7f62386bb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33443) UID: 0 2024-09-18T00:33:37.515 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.515 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:37.567 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:37.566+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:37.626 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.627 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:37.667 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:37.666+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:37.768 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:37.767+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:37.779 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.779 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:37.869 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:37.867+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:37.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:37.970 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:37.968+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.039 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:38.071 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:38.069+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:38.171 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:38.170+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.192 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:33:38.272 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:38.271+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.344 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T00:33:38.373 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:38.372+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.455 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T00:33:38.473 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:38.474 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:38.474 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-18T00:33:38.474 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-18T00:33:38.474 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:33:38.501 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:38.497+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:38.534 INFO:tasks.ceph.osd.5:Stopped 2024-09-18T00:33:38.534 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-09-18T00:33:38.535 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:33:38.535 DEBUG:teuthology.orchestra.run.smithi167:> type ceph-objectstore-tool 2024-09-18T00:33:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-18T00:33:38.554 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:33:38.555 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T00:33:38.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-09-18T00:33:38.576 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:38.575+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:38.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:38.705 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:38.704+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.719 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:38.777 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:38.776+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:38.782 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:38.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:33:38.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:38.817 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:38.835 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:38.835 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:38.852 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:38.852 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:38.878 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:38.877+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:38.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:38.990 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:38.989+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:39.052 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:39.052 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:39.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:39.103 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:39.102+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:39.180 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:39.179+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:39.204 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:39.204 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:39.204 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:39.204 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:39.204 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:39.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:39.281 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:39.280+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:39.316 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.792906782999999, 2024-09-18T00:33:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.781181564999997, 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.780888269000002, 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:39.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.780746102000002, 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:39.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.780444490999997, 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:39.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:39.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774974995000001, 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:39.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774954434999998, 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:39.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:39.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774933943000001, 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:39.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:39.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:39.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774914496000001, 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:39.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774091177000003, 2024-09-18T00:33:39.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:39.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774072220999997, 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.365 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:39.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:39.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774038502000003, 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:39.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:39.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.774015040999998, 2024-09-18T00:33:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:39.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.773995120999999, 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.379 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:39.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.773976122999997, 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:39.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.773193558000003, 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.392 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.773162894000002, 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:39.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.773141234000001, 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:39.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.401 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.773120798999997, 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:39.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 58.771090162999997, 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:39.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.410 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:39.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:39.412 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:39.410+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:39.512 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:39.511+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:39.555 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:39.555 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:39.555 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:39.555 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:39.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:39.647 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:39.646+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:39.708 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:39.708 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:39.708 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:39.708 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:39.708 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:39.714 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:39.713+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:39.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:39.815 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:39.814+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:39.861 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.390797989000006, 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:39.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.390507274000001, 2024-09-18T00:33:39.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.390460814999997, 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:39.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:39.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.390437319, 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:39.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.390414813999996, 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:39.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:39.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.389904864000002, 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:39.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.389854776000007, 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:39.889 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:39.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.389823406000005, 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:39.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.389801319, 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:39.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.389779281000003, 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:39.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388617259, 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:39.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388585938999995, 2024-09-18T00:33:39.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:39.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:39.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388554142999993, 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.916 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:39.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388529031999994, 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:39.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388485564999996, 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388463677999994, 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388406399999994, 2024-09-18T00:33:39.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:39.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.388379310999994, 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:39.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:39.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:39.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.057749272999999, 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:39.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.057730245000002, 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:39.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:39.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:39.953 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:39.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:33:39.956 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:39.953+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:40.055 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:40.054+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:40.100 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:40.100 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:40.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.d 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.c 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.1f 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.1c 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.17 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.16 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.5 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.1d 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:2.3 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:3.2 2024-09-18T00:33:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:2.2 2024-09-18T00:33:40.192 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:40.191+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:40.251 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:40.251 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:40.256 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:40.255+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:40.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:40.357 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:40.355+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:40.403 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.86609667099999, 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.721710215, 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.696393386, 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:33:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.572528966999997, 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:33:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.493820280999998, 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.493663995999995, 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.493479672000007, 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 93.375361319000007, 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.217187897000002, 2024-09-18T00:33:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.216209962999997, 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.215483351000003, 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.331636586000002, 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.330594696000006, 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.325570009000003, 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.786352225000002, 2024-09-18T00:33:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.356727731000007, 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.156482879999999, 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:33:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.088824469999999, 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:33:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.054521657999999, 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.053759087000003, 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.501 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:40.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:40.503 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:40.501+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:40.603 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:40.602+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:40.646 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:40.646 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:40.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:40.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 2.3 --file /var/log/ceph/exp.2.3.5 2024-09-18T00:33:40.738 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:40.737+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:40.798 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:40.798 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:40.805 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:40.804+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:40.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:40.905 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:40.904+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:40.960 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.991269441, 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:40.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.990889784, 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:40.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:40.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:40.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.983275998, 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:40.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:40.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.983255532, 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.976 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.980 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.98323144299999, 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:40.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.981385481, 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:40.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:40.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.981321662, 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:40.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.994 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.981292782, 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:40.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:40.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:40.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:40.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.98126780600001, 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:41.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.98124875400001, 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.97929995699999, 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:41.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.97927749999999, 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:41.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:41.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.97924906, 2024-09-18T00:33:41.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:41.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.979226752, 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.9792063, 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:41.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:41.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.97837685099999, 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.034 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.978335926, 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.978294679, 2024-09-18T00:33:41.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:41.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.978272014, 2024-09-18T00:33:41.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:41.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:158858 3.5 3:a5c4e244:::rbd_object_map.11971d10eecb:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.062003706, 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0129964899999999, 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:41.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 158858 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:41.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896392+0000", 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4810000000000001e-06 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896398+0000", 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4609999999999996e-06 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896411+0000", 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2662e-05 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896417+0000", 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896470+0000", 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2574999999999997e-05 2024-09-18T00:33:41.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896475+0000", 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1699999999999996e-06 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899257+0000", 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027825520000000002 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899265+0000", 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:33:41.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904153+0000", 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0048876250000001 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904421+0000", 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026751299999999998 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909303+0000", 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004882061 2024-09-18T00:33:41.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909339+0000", 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6464000000000002e-05 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909387+0000", 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589000000000001e-05 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:41.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:41.061 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:41.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:41.062 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:41.060+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:41.162 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:41.161+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:41.168 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:41.168 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:41.168 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:41.168 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:41.175 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:41.263 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:41.262+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:41.288 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:41.364 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:41.363+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:41.391 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:41.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:41.391 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:41.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244454673999996, 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:41.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:41.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244434210999998, 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.396 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.400 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244414816000003, 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.402 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.404 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244395660999999, 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:41.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244376231000004, 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.409 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.411 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:41.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244356576000001, 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.414 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:41.416 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.417 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244337582, 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.420 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.421 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:41.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:41.423 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:41.424 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244298657000002, 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:41.425 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.426 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:41.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244278577000003, 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.429 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:41.430 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:41.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:41.432 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:41.433 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244258833000004, 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:41.434 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.435 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:41.437 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.438 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244239054000005, 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.439 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:41.441 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.442 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244219466000004, 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.444 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.445 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244190000000003, 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.450 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244159667000005, 2024-09-18T00:33:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244132937000003, 2024-09-18T00:33:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244105540000007, 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244079897000006, 2024-09-18T00:33:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244054990999999, 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.244020820000003, 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 89.243982900000006, 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:41.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:41.501 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:41.499+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:41.601 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:41.600+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:41.608 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:41.608 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:41.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:41.702 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:41.701+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:41.764 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:41.765 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:41.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:41.817 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:41.816+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:41.891 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:41.892 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:41.901 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:41.904 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:41.902+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:41.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:33:42.005 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:42.003+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:42.046 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:42.046 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:42.055 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:42.140 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:42.139+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:42.199 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:42.199 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:42.206 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:42.205+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:42.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:42.307 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:42.306+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:42.353 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:42.354 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:42.360 INFO:teuthology.orchestra.run.smithi167.stderr:Exporting 2.3 info 2.3( v 19'1 (0'0,19'1] local-lis/les=18/19 n=1 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-18T00:33:42.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:Read #2:c4c92e5a:::rbd_trash:head# 2024-09-18T00:33:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:Export successful 2024-09-18T00:33:42.409 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:42.408+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:42.467 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:42.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:42.467 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:42.467 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:42.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:42.519 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:42.518+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:42.579 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:42.579 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:42.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:42.610 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:42.609+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:42.711 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:42.709+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:42.732 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.209418366999998, 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.197693149000003, 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.197399853, 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.197257686, 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.196956075000003, 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.191486578999999, 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.191466019000003, 2024-09-18T00:33:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.191445526999999, 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.191426079999999, 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.190602761000001, 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.190583805000003, 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.190550086000002, 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.190526624999997, 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.190506704999997, 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.190487707000003, 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.189705142000001, 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.189674478000001, 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.189652817999999, 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.189632383000003, 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.187601747000002, 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:42.819 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:42.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:42.821 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:42.819+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:42.882 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 2.3 2024-09-18T00:33:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:33:42.921 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:42.920+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:42.981 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:42.981 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:42.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:43.034 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:43.033+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:43.099 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:43.099 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:43.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:43.148 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:43.147+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:43.225 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:43.224+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:43.253 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.782334762999994, 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.782044048000003, 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781997588999999, 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781974093000002, 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781951587999998, 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781441638000004, 2024-09-18T00:33:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781391549999995, 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781360179999993, 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781338093000002, 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.781316055000005, 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.780154033000002, 2024-09-18T00:33:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.780122712999997, 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.780090916999995, 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.780065805999996, 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.780022338999999, 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.780000451999996, 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.779943173999996, 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.779916084999996, 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.449286047000001, 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.449267018999997, 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.341 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:43.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:43.343 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:43.341+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:43.443 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:43.442+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:43.485 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:43.486 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:43.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:43.543 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:43.542+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:43.597 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:43.598 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:43.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:43.644 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:43.642+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:43.711 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.174486152, 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.03009969599999, 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.004782867, 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16277 3.0 e39/23 3:0437b7fe:::rbd_data.1197c78141c8.0000000000000005:head v 39'54, mlcod=39'52)", 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 100.880918448, 2024-09-18T00:33:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039838699999999996, 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828717+0000", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7e-07 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828721+0000", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1860000000000002e-06 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828728+0000", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6669999999999999e-06 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828733+0000", 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7609999999999998e-06 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828814+0000", 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1724000000000006e-05 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.828835+0000", 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1066000000000001e-05 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832658+0000", 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038223530000000001 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.832701+0000", 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2743000000000001e-05 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 100.802209762, 2024-09-18T00:33:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 100.802053477, 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 100.801869153, 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 96.683750799999999, 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 95.525577377999994, 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 95.524599444000003, 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 95.523872831999995, 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.640026066999994, 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.638984176999998, 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.633959489999995, 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 91.094741705999994, 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.665117211999998, 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.464872360999998, 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:124366 3.4 e77/23 3:252c4d91:::rbd_data.1197452c11c5.000000000000002b:head v 77'407, mlcod=76'402)", 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.397213950999998, 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003814422, 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312421+0000", 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312422+0000", 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312427+0000", 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5079999999999996e-06 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312437+0000", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0104e-05 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312444+0000", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2269999999999996e-06 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312495+0000", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0807999999999999e-05 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.312516+0000", 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0628999999999998e-05 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316190+0000", 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003673754 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.316236+0000", 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5918999999999999e-05 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.362911138999998, 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126346 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'318, mlcod=78'313)", 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.362148568000002, 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039535359999999997, 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347487+0000", 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347493+0000", 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347504+0000", 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1453e-05 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347511+0000", 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9500000000000004e-06 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347569+0000", 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7497999999999997e-05 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.347589+0000", 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9922e-05 2024-09-18T00:33:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351410+0000", 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003821301 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351440+0000", 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9950999999999998e-05 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.796 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:43.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:43.798 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:43.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:43.799 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:43.799 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:43.796+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:43.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:43.800 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:43.801 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:43.802 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:43.898 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:43.897+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:159623 3.18 3:1a08ed1b:::rbd_header.1197120e014:head [call rbd.get_data_pool in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e130)", 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:43.955779+0000", 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0001572, 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000178297, 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:43.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159623 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955779+0000", 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955779+0000", 2024-09-18T00:33:43.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955779+0000", 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2200000000000003e-07 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955783+0000", 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5750000000000001e-06 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955792+0000", 2024-09-18T00:33:43.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2129999999999997e-06 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955798+0000", 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7660000000000004e-06 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955834+0000", 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6273000000000003e-05 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:43.955913+0000", 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8949000000000006e-05 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-18T00:33:43.961 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:43.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:44.009 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:44.008+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:44.100 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:44.098+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:44.114 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:44.114 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:44.114 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:44.114 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:44.114 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:44.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:44.201 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:44.199+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.25685074099999, 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:44.226 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:44.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:44.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.256471084, 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:44.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.248857298, 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24883683199999, 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.248812743, 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.246966781, 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:44.248 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:44.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24690296199999, 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:44.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24687408200001, 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:44.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:44.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.246849106, 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.246830054, 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:44.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.244881257, 2024-09-18T00:33:44.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.2448588, 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24483035999999, 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.244808052, 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.2447876, 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.288 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:44.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.243958151, 2024-09-18T00:33:44.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24391722599999, 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24387597899999, 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.24385331400001, 2024-09-18T00:33:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:158858 3.5 3:a5c4e244:::rbd_object_map.11971d10eecb:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.3275850059999996, 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0129964899999999, 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 158858 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896392+0000", 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4810000000000001e-06 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896398+0000", 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4609999999999996e-06 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896411+0000", 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2662e-05 2024-09-18T00:33:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896417+0000", 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896470+0000", 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2574999999999997e-05 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-18T00:33:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896475+0000", 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1699999999999996e-06 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899257+0000", 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027825520000000002 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899265+0000", 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904153+0000", 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0048876250000001 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904421+0000", 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026751299999999998 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909303+0000", 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004882061 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909339+0000", 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6464000000000002e-05 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909387+0000", 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589000000000001e-05 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:44.316 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:44.318 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:44.318 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:44.316+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:44.323 INFO:teuthology.orchestra.run.smithi167.stdout: marking collection for removal 2024-09-18T00:33:44.323 INFO:teuthology.orchestra.run.smithi167.stdout:setting '_remove' omap key 2024-09-18T00:33:44.323 INFO:teuthology.orchestra.run.smithi167.stdout:finish_remove_pgs 2.3_head removing 2.3 2024-09-18T00:33:44.331 INFO:teuthology.orchestra.run.smithi167.stdout:Remove successful 2024-09-18T00:33:44.418 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:44.416+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:44.422 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:44.423 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:44.423 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:44.423 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:44.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:44.519 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:44.518+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:44.575 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:44.575 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:44.575 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:44.575 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:44.575 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:44.584 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:44.620 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:44.619+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:44.687 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:44.687 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:44.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:44.687 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:44.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540309949999994, 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:44.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540289486999995, 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:44.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:44.696 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540270092, 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.700 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540250936999996, 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.701 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:44.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:44.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540231507000001, 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.705 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540211851999999, 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.709 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540192857999997, 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540153932999999, 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540133853, 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540114109000001, 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:44.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.730 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540094330000002, 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:44.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:44.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540074742000002, 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.735 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:44.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540045276000001, 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:44.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:44.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.540014943000003, 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.744 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:44.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.748 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.539988213000001, 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:44.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:44.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.752 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.539960816000004, 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.753 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.757 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.539935173000003, 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:44.761 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.539910266999996, 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.762 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:44.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.539876096, 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:44.766 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:44.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:44.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 92.539838176000004, 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.771 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:44.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:44.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:44.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:44.775 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:44.776 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:44.777 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:44.775+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:44.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.3.5 2024-09-18T00:33:44.883 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:44.883 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:44.883 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:44.884 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:44.881+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:44.893 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:44.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:33:44.977 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:44.976+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:45.043 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:45.043 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:45.043 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:45.043 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:45.044 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:45.052 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:45.099 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:45.097+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.80053186799999, 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.161 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.163 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.165 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.791443606, 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:45.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.169 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.791419238, 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.170 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:45.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:45.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.791406658, 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.174 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.176 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.178 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.791396382, 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.182 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.779542198, 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.183 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:45.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.779521828, 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:45.187 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.188 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:45.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.777562191, 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.194 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.777552922, 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.198 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:45.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.202 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.77553962099999, 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.206 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.77552145999999, 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.207 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:45.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.773223577, 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:45.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.215 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.773183127, 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.216 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:45.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:45.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:45.220 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.773087631, 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:45.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:45.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.224 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.771511906, 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.225 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:45.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.771491188, 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:45.229 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:45.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.771467655, 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.234 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:45.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.77144505699999, 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:45.242 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 112.76948950000001, 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.243 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:45.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:45.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:45.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.248 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:156379 3.a 3:51f6e3de:::rbd_data.1197d85df63.0000000000000022:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 23.307194843000001, 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.93035060199999997, 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 156379 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.249 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851400+0000", 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.945e-06 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851408+0000", 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2719999999999997e-06 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851428+0000", 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.031e-05 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851438+0000", 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6479999999999998e-06 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851512+0000", 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4019999999999999e-05 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for peered", 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851523+0000", 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.145e-05 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779503+0000", 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.92797969400000002 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779638+0000", 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00013492800000000001 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779739+0000", 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010061899999999999 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781662+0000", 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001923063 2024-09-18T00:33:45.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781680+0000", 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8848e-05 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781718+0000", 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7240999999999998e-05 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781748+0000", 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0564000000000001e-05 2024-09-18T00:33:45.254 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.255 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.255 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.255 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.255 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.255 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:45.256 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:45.257 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:45.254+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:45.357 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:45.356+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:45.400 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:45.400 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:45.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:45.400 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:45.409 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:45.459 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:45.457+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:45.515 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:45.515 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:45.515 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:45.515 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:45.515 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:45.523 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:45.567 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:45.565+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:45.628 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.039015061000001, 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.629 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:45.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:45.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.038949875999997, 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.634 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.638 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.038832966000001, 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:45.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.037122154999999, 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.643 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.034974603999999, 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.648 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.033190552000001, 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:45.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.033154516000003, 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:45.657 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:45.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.661 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.033144321999998, 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:45.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:45.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:45.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.666 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.033134478000001, 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:45.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.031022041999996, 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030928273000001, 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030907583999998, 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:45.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.687 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030888799000003, 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:45.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:45.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:45.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030814728999999, 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030795275999999, 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.699 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:45.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030775912000003, 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.703 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:45.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:45.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.707 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030601863000001, 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.708 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:45.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.030571498, 2024-09-18T00:33:45.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.716 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.029124631000002, 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.717 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:45.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.721 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 55.029099172000002, 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.722 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:45.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:45.726 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:45.728 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:45.725+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:45.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:45.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:45.837 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:45.837 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:45.837 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:45.838 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:45.838 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:45.836+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:45.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:45.929 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:45.930 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:45.927+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:45.930 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:45.930 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:33:45.949 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:45.949 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:45.968 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:45.969 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:45.988 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:45.988 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:46.004 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.004 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.006 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:46.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:46.026 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:46.069 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:46.068+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:46.131 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:46.129+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:46.133 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.133 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:46.232 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:46.230+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:46.243 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:46.243 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:46.247 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:46.247 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:46.286 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.286 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:46.333 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:46.331+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:46.433 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:46.431+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:46.439 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.440 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:46.534 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:46.532+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:46.552 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.552 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:46.635 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:46.633+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:46.663 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.663 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:46.735 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:46.733+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:46.744 INFO:teuthology.orchestra.run.smithi167.stdout:get_pg_num_history pg_num_history pg_num_history(e124 pg_nums {1={15=1},2={18=8},3={23=32}} deleted_pools ) 2024-09-18T00:33:46.744 INFO:teuthology.orchestra.run.smithi167.stdout:Importing pgid 2.3 2024-09-18T00:33:46.744 INFO:teuthology.orchestra.run.smithi167.stdout:Write #2:c4c92e5a:::rbd_trash:head# 2024-09-18T00:33:46.745 INFO:teuthology.orchestra.run.smithi167.stdout:snapset 0=[]:{} 2024-09-18T00:33:46.749 INFO:teuthology.orchestra.run.smithi167.stdout:write_pg epoch 104 info 2.3( v 19'1 (0'0,19'1] local-lis/les=18/19 n=1 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-18T00:33:46.749 INFO:teuthology.orchestra.run.smithi167.stdout:Import successful 2024-09-18T00:33:46.823 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.823 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:46.876 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:46.875+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:46.937 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:46.935+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:46.941 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:46.942 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:46.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:47.038 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:47.036+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:47.096 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.096 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:47.149 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:47.148+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:47.208 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.208 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:47.240 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:47.238+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:47.271 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /var/log/ceph/exp.2.3.5 2024-09-18T00:33:47.341 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:47.339+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:47.360 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.360 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.369 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:47.442 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:47.440+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:47.482 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.482 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:47.542 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:47.541+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:47.635 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.635 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:47.644 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:47.642+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:47.745 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:47.743+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:47.747 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.747 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:47.845 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:47.843+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:47.867 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:47.868 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:47.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:47.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T00:33:47.961 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:47.959+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:48.021 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:48.021 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:48.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:48.047 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:48.045+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:48.148 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:48.146+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:48.173 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:48.173 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:48.182 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:48.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:48.249 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:48.248+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:48.326 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:48.326 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:48.334 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:48.367 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:48.367 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:48.378 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:48.376+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:48.383 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:48.399 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:48.400 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:48.415 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:48.431 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:48.439 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:48.439 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:48.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:48.449 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:48.450 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:48.449+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:48.467 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:48.468 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:48.469 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:48.551 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:48.549+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.594 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 58.004614891000003, 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.595 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:48.596 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.597 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.598 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 58.004549705999999, 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.599 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.601 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:48.601 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.601 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.602 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:48.603 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.604 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 58.004432796000003, 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:48.605 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.607 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.608 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:48.609 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 58.002721985000001, 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.610 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:48.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.613 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.614 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 58.000574434000001, 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.615 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.616 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:48.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:48.618 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:48.619 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.998790382000003, 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:48.620 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.621 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.622 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.623 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.998754345999998, 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.624 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.625 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.626 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:48.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.628 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.998744152, 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:48.629 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:48.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.633 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.998734308000003, 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.634 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:48.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996621871999999, 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.638 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.640 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.642 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996528103000003, 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996507414, 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996488628999998, 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:48.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996414559000002, 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.656 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:48.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:48.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:48.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996395106000001, 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:48.660 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.664 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996375741999998, 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.665 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:48.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:48.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996201693000003, 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.670 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:48.671 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:48.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:48.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.674 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.996171328000003, 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.675 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:48.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.678 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.994724460999997, 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:48.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:48.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:48.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 57.994699001999997, 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:48.683 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.684 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:48.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:48.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:48.687 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:48.688 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:48.687+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:48.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:48.790 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:48.788+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-18T00:33:48.798 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.3.0:3115 3.18 e135/23 3:1a556e27:::rbd_data.119755f34769.0000000000000007:c v 135'438, mlcod=134'434)", 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:48.795280+0000", 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0023390139999999999, 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023635629999999999, 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795280+0000", 2024-09-18T00:33:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795280+0000", 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795280+0000", 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2899999999999999e-07 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795285+0000", 2024-09-18T00:33:48.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6410000000000001e-06 2024-09-18T00:33:48.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795297+0000", 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2291e-05 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:48.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795305+0000", 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0509999999999997e-06 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795359+0000", 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4376999999999998e-05 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.795380+0000", 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0445000000000002e-05 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:48.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:48.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:48.804 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-18T00:33:48.804 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-18T00:33:48.804 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:48.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:48.891 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:48.888+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:48.960 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:48.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:48.960 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:48.960 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:48.960 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:48.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:49.012 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:49.011+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.550690750000001, 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:49.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.538965532000006, 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:49.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:49.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.538672235999996, 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.538530069000004, 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:49.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.538228458000006, 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:49.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.532758962000003, 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:49.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.532738402000007, 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:49.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:49.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.532717910000002, 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.532698463000003, 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.531875143999997, 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.531856188000006, 2024-09-18T00:33:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.531822469000005, 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.531799007999993, 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.531779087999993, 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.531760090000006, 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.530977524999997, 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.530946861000004, 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.530925201000002, 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.530904766000006, 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.528874130000005, 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.170 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:49.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:49.172 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:49.170+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:49.272 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:49.271+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:49.316 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:49.316 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:49.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:49.408 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:49.407+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:49.468 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:49.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:49.474 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:49.473+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:49.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:49.575 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:49.574+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:49.621 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.150611947000002, 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.150321231999996, 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.150274773000007, 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.150251276999995, 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.150228772000006, 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.149718821999997, 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.149668734000002, 2024-09-18T00:33:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.149637364, 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.149615276999995, 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.149593238999998, 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148431216999995, 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148399897000004, 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148368101000003, 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148342990000003, 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148299523000006, 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148277636000003, 2024-09-18T00:33:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148220358000003, 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.148193269000004, 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.817563231000001, 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.817544202999997, 2024-09-18T00:33:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:49.718 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:49.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:49.720 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:49.718+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:49.821 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:49.819+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:49.829 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:49.829 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:49.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:49.922 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:49.921+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:49.987 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:49.987 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:49.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:50.038 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:50.036+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:50.123 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:50.122+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.60362655599999, 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.4592401, 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.433923271, 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.231350166, 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.231193881, 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.23100955699999, 2024-09-18T00:33:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 103.11289120399999, 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.954717782, 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.953739848, 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.953013236, 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.069166471000003, 2024-09-18T00:33:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.068124581000006, 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.063099894000004, 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.523882110000002, 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.094257615999993, 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.894012764999999, 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.792051542999999, 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.4.0:1859 3.9 e131/23 3:91d130a7:::rbd_data.1197cee1465b.0000000000000008:10 v 131'495, mlcod=129'491)", 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.206681852, 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041144670000000001, 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.27e-07 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932099+0000", 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2209999999999996e-06 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932107+0000", 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9419999999999995e-06 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932124+0000", 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6416999999999999e-05 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932176+0000", 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2562999999999998e-05 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932197+0000", 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0528999999999999e-05 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.936161+0000", 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039646580000000002 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.936208+0000", 2024-09-18T00:33:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6810000000000001e-05 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.4.0:1860 3.9 e131/23 3:95346bbc:::rbd_data.1197cee1465b.0000000000000059:10 v 131'497, mlcod=129'491)", 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2059812660000002, 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062238270000000004, 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932795+0000", 2024-09-18T00:33:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5000000000000002e-07 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932803+0000", 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0790000000000001e-06 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932813+0000", 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7710000000000001e-06 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932819+0000", 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932865+0000", 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6223000000000001e-05 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932886+0000", 2024-09-18T00:33:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1458999999999999e-05 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.938973+0000", 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060871420000000002 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.939018+0000", 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4603e-05 2024-09-18T00:33:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.1.0:1679 3.4 e135/23 3:23a0225a:::rbd_data.119755f34769.0000000000000009:c v 135'593, mlcod=132'587)", 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.3471468440000001, 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045316699999999998, 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8599999999999998e-07 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791634+0000", 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7809999999999996e-06 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791641+0000", 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9290000000000001e-06 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791645+0000", 2024-09-18T00:33:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0500000000000002e-06 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.792177+0000", 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053202700000000002 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.792197+0000", 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9899e-05 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.796115+0000", 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039178759999999998 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.796160+0000", 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5621999999999998e-05 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.240 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:50.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:50.243 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:50.241+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:50.343 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:50.342+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:50.351 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:50.351 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:50.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:50.444 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:50.442+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:50.463 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:50.463 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:50.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:50.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:50.558 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:50.556+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:50.591 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.652469357, 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.6520897, 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.644475914, 2024-09-18T00:33:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.644455448, 2024-09-18T00:33:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.644431359, 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.642585397, 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.642521578, 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.642492698, 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.64246772200001, 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.64244866999999, 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.640499873, 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:50.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.640477416, 2024-09-18T00:33:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.640448976, 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.640426668, 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.640406216, 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.63957676699999, 2024-09-18T00:33:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.639535842, 2024-09-18T00:33:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.639494595, 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.63947193, 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:158858 3.5 3:a5c4e244:::rbd_object_map.11971d10eecb:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 11.723203622, 2024-09-18T00:33:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0129964899999999, 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 158858 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896392+0000", 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4810000000000001e-06 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896398+0000", 2024-09-18T00:33:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4609999999999996e-06 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896411+0000", 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2662e-05 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896417+0000", 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896470+0000", 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2574999999999997e-05 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896475+0000", 2024-09-18T00:33:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1699999999999996e-06 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899257+0000", 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027825520000000002 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899265+0000", 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904153+0000", 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0048876250000001 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904421+0000", 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026751299999999998 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909303+0000", 2024-09-18T00:33:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004882061 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909339+0000", 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6464000000000002e-05 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909387+0000", 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589000000000001e-05 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:50.737 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:50.738 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:50.738 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:50.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:50.740 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:50.741 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:50.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:50.742 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:50.743 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:50.744 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:50.744 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:50.745 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:50.736+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:50.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:33:50.859 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:50.858+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:50.861 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:50.861 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:50.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:50.940 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:50.938+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:50.978 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:50.978 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:50.987 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:51.040 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:51.039+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:51.091 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.091 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:51.141 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:51.140+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:51.242 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:51.241+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:51.243 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.244 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:51.342 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:51.341+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:51.356 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.356 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.365 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:51.443 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:51.442+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:51.468 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.469 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.477 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:51.544 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:51.543+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:51.622 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.622 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.632 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:51.645 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:51.643+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:51.735 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.735 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.743 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:51.746 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:51.744+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:51.801 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:33:51.846 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:51.844+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:51.854 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.854 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:51.947 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:51.946+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:51.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:52.048 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:52.047+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:52.090 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:52.090 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:52.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:52.183 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:52.182+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:52.243 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:52.243 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:52.249 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:52.248+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:52.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:52.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-18T00:33:52.339 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:52.339 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:33:52.339 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.161349 2024-09-18T00:33:52.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.16134943339179608 2024-09-18T00:33:52.383 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:52.382+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:52.397 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:52.397 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:52.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:52.451 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:52.449+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:52.551 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:52.550+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:52.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:52.652 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:52.651+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:52.664 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:52.665 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:52.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:52.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:52.778 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:52.778 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:52.779 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:52.777+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:52.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.0 primary-affinity to 0.161349 (8105742) 2024-09-18T00:33:52.866 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:52.865+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:52.885 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:52.905 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:52.905 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:52.921 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:52.925 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:52.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:52.925 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:52.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:52.938 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:52.954 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:52.953+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:52.955 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:52.973 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:52.990 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:52.993 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:52.994 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:53.045 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.50753862099999, 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:53.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.363152165, 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:53.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.054 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.337835336, 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:53.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:53.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.135262231, 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:53.059 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.135105946, 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:53.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.13492162199999, 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.01680326899999, 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:53.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:53.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 104.858629847, 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:53.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 104.857651913, 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 104.856925301, 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:53.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.973078536, 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.091 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:53.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.97203664600001, 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:53.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:53.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.967011959, 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:53.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:53.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 100.427794175, 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:53.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:53.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:53.109 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 91.998169680999993, 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:53.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:53.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:53.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.797924829999999, 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:53.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:53.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.695963608, 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:53.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:53.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.4.0:1859 3.9 e131/23 3:91d130a7:::rbd_data.1197cee1465b.0000000000000008:10 v 131'495, mlcod=129'491)", 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1105939169999992, 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041144670000000001, 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.27e-07 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932099+0000", 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2209999999999996e-06 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932107+0000", 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9419999999999995e-06 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932124+0000", 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6416999999999999e-05 2024-09-18T00:33:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932176+0000", 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2562999999999998e-05 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932197+0000", 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0528999999999999e-05 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.936161+0000", 2024-09-18T00:33:53.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039646580000000002 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.936208+0000", 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6810000000000001e-05 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.4.0:1860 3.9 e131/23 3:95346bbc:::rbd_data.1197cee1465b.0000000000000059:10 v 131'497, mlcod=129'491)", 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:53.127 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1098933310000003, 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062238270000000004, 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:53.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932795+0000", 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5000000000000002e-07 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932803+0000", 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0790000000000001e-06 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932813+0000", 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7710000000000001e-06 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932819+0000", 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932865+0000", 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6223000000000001e-05 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932886+0000", 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1458999999999999e-05 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.938973+0000", 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060871420000000002 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.939018+0000", 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4603e-05 2024-09-18T00:33:53.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.1.0:1679 3.4 e135/23 3:23a0225a:::rbd_data.119755f34769.0000000000000009:c v 135'593, mlcod=132'587)", 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2510589090000002, 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045316699999999998, 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:53.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8599999999999998e-07 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791634+0000", 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7809999999999996e-06 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791641+0000", 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9290000000000001e-06 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791645+0000", 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0500000000000002e-06 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.792177+0000", 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053202700000000002 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.792197+0000", 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9899e-05 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.796115+0000", 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039178759999999998 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.796160+0000", 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5621999999999998e-05 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.136 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:53.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:53.138 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:53.137+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:53.241 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:53.239+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:53.284 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:53.284 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:53.284 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:53.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:53.378 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:53.377+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:53.436 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:53.437 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:53.442 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:53.441+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:53.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:53.543 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:53.542+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.619179219, 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.61879956200001, 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:33:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:33:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:33:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.611185776, 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:33:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:33:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.61116531, 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:33:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.611141221, 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:33:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:33:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:33:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:33:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.60929525900001, 2024-09-18T00:33:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:33:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:33:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:33:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:33:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:33:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.60923144, 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:33:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.60920256, 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:33:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:33:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.60917758399999, 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:33:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:33:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.609158532, 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:33:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:33:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:33:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.607209735, 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:33:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.607187278, 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:33:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:33:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.607158838, 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.60713653000001, 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:33:53.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.607116078, 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:33:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:53.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.606286629, 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:53.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.606245704, 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:33:53.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:53.672 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.606204457, 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:53.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:33:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 119.606181792, 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:33:53.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:158858 3.5 3:a5c4e244:::rbd_object_map.11971d10eecb:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-18T00:33:53.681 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.689913484, 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0129964899999999, 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 158858 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:53.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896392+0000", 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4810000000000001e-06 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896398+0000", 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4609999999999996e-06 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896411+0000", 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2662e-05 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896417+0000", 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896470+0000", 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2574999999999997e-05 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896475+0000", 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1699999999999996e-06 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899257+0000", 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027825520000000002 2024-09-18T00:33:53.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899265+0000", 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904153+0000", 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0048876250000001 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:53.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904421+0000", 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026751299999999998 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909303+0000", 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004882061 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909339+0000", 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6464000000000002e-05 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909387+0000", 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589000000000001e-05 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:53.688 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:53.690 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:53.690 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:53.688+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:53.790 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:53.789+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:53.805 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:53.806 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:53.806 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:53.806 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:53.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:53.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:33:53.891 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:53.890+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:53.960 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:53.960 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:53.960 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:53.960 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:53.960 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:53.969 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:54.013 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:54.012+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926926358, 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:33:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.076 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.077 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:33:54.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926905895, 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.079 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:33:54.080 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92688649999999, 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:54.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92686734500001, 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.088 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.089 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.092 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926847915, 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.093 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:33:54.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.095 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.096 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92682825999999, 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:33:54.097 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:33:54.099 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.100 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.101 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92680926600001, 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.102 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:33:54.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:33:54.105 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92677034099999, 2024-09-18T00:33:54.106 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:54.107 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.108 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.111 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.111 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:33:54.111 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926750261, 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.112 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:33:54.114 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.115 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.116 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926730517, 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.117 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:33:54.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.121 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926710738, 2024-09-18T00:33:54.122 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:54.123 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.124 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:33:54.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:33:54.126 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92669115, 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:33:54.128 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.129 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.130 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.131 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:54.132 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926661684, 2024-09-18T00:33:54.132 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:33:54.132 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:54.133 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.134 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.135 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.136 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926631351, 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.137 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:54.138 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.139 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:33:54.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.141 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926604621, 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.142 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:54.143 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.144 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.145 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:54.146 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926577224, 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:54.147 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:33:54.148 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.149 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926551581, 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.151 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:33:54.152 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.153 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.92652667500001, 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:33:54.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:33:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:54.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:33:54.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:33:54.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.162 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926492504, 2024-09-18T00:33:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:33:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.163 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:33:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:54.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:33:54.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 101.926454584, 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.170 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:33:54.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.174 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:54.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:54.176 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:54.174+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:54.276 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:54.275+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:54.322 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:54.322 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:54.322 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:54.322 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:54.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:54.415 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:54.414+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:54.474 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:54.474 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:54.475 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:54.478 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:54.477+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:54.483 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:54.579 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:54.578+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.268503667, 2024-09-18T00:33:54.629 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:54.630 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.631 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:54.633 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.259415405, 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.634 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.635 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.635 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:54.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.635 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.635 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:54.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.637 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:54.638 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.639 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.259391037, 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:54.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.641 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.259378457, 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:54.644 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:54.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:54.647 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.648 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.259368181, 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.649 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:54.650 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.651 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.653 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.247513997, 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.654 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.655 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:54.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:54.658 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.247493627, 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.659 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.661 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:54.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.24553399, 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.664 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.666 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.667 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.668 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.245524721, 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.670 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:54.670 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.670 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:54.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.673 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.24351142, 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:54.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.676 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:54.678 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.243493259, 2024-09-18T00:33:54.679 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:54.680 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.681 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.24119537599999, 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.684 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.685 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:54.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:54.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.24115492599999, 2024-09-18T00:33:54.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:54.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.24105943000001, 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.693 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:54.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.239483705, 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:54.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.701 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.239462987, 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:54.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:54.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.23943945400001, 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:54.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:54.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.23941685600001, 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.711 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:54.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:54.715 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 122.237461299, 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:54.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:54.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:54.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:156379 3.a 3:51f6e3de:::rbd_data.1197d85df63.0000000000000022:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 32.775166642000002, 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.93035060199999997, 2024-09-18T00:33:54.722 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 156379 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:54.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:54.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851400+0000", 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.945e-06 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851408+0000", 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2719999999999997e-06 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851428+0000", 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.031e-05 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851438+0000", 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6479999999999998e-06 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851512+0000", 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4019999999999999e-05 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for peered", 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851523+0000", 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.145e-05 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779503+0000", 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.92797969400000002 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779638+0000", 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00013492800000000001 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779739+0000", 2024-09-18T00:33:54.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010061899999999999 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781662+0000", 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001923063 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781680+0000", 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8848e-05 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.728 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781718+0000", 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7240999999999998e-05 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781748+0000", 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0564000000000001e-05 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:54.729 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:54.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:54.731 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:54.729+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:33:54.831 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:54.830+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:54.880 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:54.880 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:54.881 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:54.881 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:54.890 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:54.934 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:54.933+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:54.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T00:33:54.999 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:54.999 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:54.999 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:55.008 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:55.050 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:55.048+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:55.116 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:55.133 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:55.133 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:55.131+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:55.148 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:55.148 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.564597915999997, 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.154 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.155 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.156 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:55.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.564532731, 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.159 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:55.160 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.161 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.162 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.564415820999997, 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.562705010000002, 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:55.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.171 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.560557458999995, 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:55.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:55.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.558773407000004, 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:55.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:55.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:55.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:55.180 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.558737371000007, 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.184 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.558727176999994, 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.185 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.558717333000004, 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.190 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:55.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556604897, 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:55.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:55.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556511127999997, 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.198 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:55.202 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556490439000001, 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:55.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:55.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556471654000006, 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:55.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556397583999996, 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.211 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.212 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.215 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556378131000002, 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.217 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.219 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556358767000006, 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.220 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.221 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:55.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556184717999997, 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:55.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.226 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:55.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.229 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.556154352999997, 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.230 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:55.233 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.554707485999998, 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.234 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:55.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:55.238 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 64.554682026999998, 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:55.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:55.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:55.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.243 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.243 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:55.243 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:55.243 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:55.244 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:55.244 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:55.245 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:55.245 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:55.242+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:55.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:55.246 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:55.247 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:55.247 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:55.247 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:55.248 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:55.345 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:55.343+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:55.391 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:55.391 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:55.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:55.484 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:55.483+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:55.544 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:55.544 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:55.546 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:55.545+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:55.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:55.647 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:55.646+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:55.696 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:55.696 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:55.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:55.748 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:55.747+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:55.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:55.849 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:55.847+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:55.930 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:55.931 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:55.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:55.983 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:55.982+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:56.042 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.042 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:56.051 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:56.049+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:56.151 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:56.150+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:56.195 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.195 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:56.290 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:56.287+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:56.348 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.348 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.353 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:56.352+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:56.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:56.454 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:56.453+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:56.499 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.499 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:56.555 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:56.554+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:56.651 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.652 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.656 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:56.655+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:56.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:56.757 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:56.756+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:33:56.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T00:33:56.894 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:56.893+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:56.959 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:56.957+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:56.969 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:56.969 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:56.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:33:57.060 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:57.059+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:57.083 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:57.083 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:57.092 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:33:57.162 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:57.161+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:57.195 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:57.196 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:57.204 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:33:57.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T00:33:57.262 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:57.261+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:57.308 INFO:teuthology.orchestra.run.smithi167.stdout:ERROR: (22) Invalid argument 2024-09-18T00:33:57.308 INFO:teuthology.orchestra.run.smithi167.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T00:33:57.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:33:57.363 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:57.362+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:57.369 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-18T00:33:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T00:33:57.386 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-18T00:33:57.386 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T00:33:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-18T00:33:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T00:33:57.417 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-18T00:33:57.418 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T00:33:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-18T00:33:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T00:33:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-18T00:33:57.452 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-18T00:33:57.452 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T00:33:57.461 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:57.461 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:57.461 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:57.461 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:57.463 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:57.462+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:57.468 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-18T00:33:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T00:33:57.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:33:57.471 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T00:33:57.472 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T00:33:57.565 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:57.563+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:57.573 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:57.574 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:57.574 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:57.574 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:57.574 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:57.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:33:57.666 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:57.665+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:57.686 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.326400886, 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.687 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.688 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.689 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:33:57.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.317312624, 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.692 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:33:57.693 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.694 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.695 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.317288256, 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:33:57.697 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.698 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.700 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.31727567599999, 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:33:57.702 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.703 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.3172654, 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.705 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.706 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.707 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:33:57.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.709 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.305411216, 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.710 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.711 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:33:57.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.30539084599999, 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:33:57.716 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.717 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.718 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.303431209, 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:57.719 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.720 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:33:57.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:33:57.722 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.30342194000001, 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:33:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:57.724 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:33:57.725 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.726 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.301408639, 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.728 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:33:57.730 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.731 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.732 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.301390478, 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.733 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.735 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:33:57.735 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:33:57.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.735 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:33:57.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:33:57.737 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.299092595, 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.738 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:57.739 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.740 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.742 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.299052145, 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.745 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.746 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.747 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.298956649, 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:57.748 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.749 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.750 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.297380924, 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:33:57.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.753 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.754 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.755 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.29736020599999, 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.756 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:33:57.757 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:33:57.758 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.759 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:57.760 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.297336673, 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:33:57.762 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:33:57.763 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.764 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.297314075, 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.765 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.766 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:33:57.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:33:57.768 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 125.295358518, 2024-09-18T00:33:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:33:57.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.773 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:156379 3.a 3:51f6e3de:::rbd_data.1197d85df63.0000000000000022:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 35.833063860999999, 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.93035060199999997, 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:57.775 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 156379 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:57.776 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851400+0000", 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.945e-06 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851408+0000", 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2719999999999997e-06 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.777 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851428+0000", 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.031e-05 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851438+0000", 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6479999999999998e-06 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851512+0000", 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4019999999999999e-05 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for peered", 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851523+0000", 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.145e-05 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779503+0000", 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.92797969400000002 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779638+0000", 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00013492800000000001 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779739+0000", 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010061899999999999 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781662+0000", 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001923063 2024-09-18T00:33:57.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781680+0000", 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8848e-05 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781718+0000", 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7240999999999998e-05 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781748+0000", 2024-09-18T00:33:57.781 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0564000000000001e-05 2024-09-18T00:33:57.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.782 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:57.782 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:57.782 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:57.783 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:33:57.784 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-18T00:33:57.782+0000 7f9d88533640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33504) UID: 0 2024-09-18T00:33:57.825 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-18T00:33:57.826 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T00:33:57.826 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T00:33:57.826 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 1.000000 2024-09-18T00:33:57.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-18T00:33:57.841 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-18T00:33:57.902 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:57.901+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:57.938 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:57.938 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:57.938 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:33:57.938 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:57.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:33:57.985 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:57.983+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:58.051 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:58.051 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:33:58.052 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:33:58.052 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:33:58.052 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:58.060 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:33:58.086 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-18T00:33:58.084+0000 7fb349873640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33508) UID: 0 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:58.166 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.576474930000003, 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:58.167 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.168 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:33:58.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.170 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.576409745000007, 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.171 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.172 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:33:58.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:33:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.576292835000004, 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:33:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.574582023999994, 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:33:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.572434473000001, 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:33:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:33:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.570650420999996, 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.190 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:33:58.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:33:58.192 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.193 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.570614384999999, 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.194 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.195 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:33:58.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.197 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.570604191000001, 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:33:58.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.200 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.570594346999997, 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.203 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.204 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:33:58.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:33:58.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.207 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568481911000006, 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.208 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:33:58.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:33:58.210 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.211 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568388142000003, 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.212 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.213 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.216 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568367452999993, 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:33:58.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:33:58.219 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.220 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568348667999999, 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.221 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:58.222 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.223 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.225 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568274598000002, 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.226 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:33:58.228 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.229 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568255144999995, 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.230 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.231 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:33:58.233 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568235780999998, 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:33:58.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.236 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:33:58.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568061732000004, 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.240 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:33:58.241 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.242 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.568031367000003, 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.244 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.245 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:33:58.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.566584500000005, 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.249 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:33:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.251 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 67.566559041000005, 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:33:58.253 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:33:58.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:33:58.256 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:33:58.258 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:33:58.258 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:33:58.259 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:58.257+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:58.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T00:33:58.359 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:58.358+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:58.363 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:58.363 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:58.363 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:58.363 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:58.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T00:33:58.460 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-18T00:33:58.459+0000 7f5d7eb1b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33500) UID: 0 2024-09-18T00:33:58.515 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:58.515 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:58.515 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:58.516 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:58.516 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:58.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T00:33:58.564 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-18T00:33:58.560+0000 7f746551b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33448) UID: 0 2024-09-18T00:33:58.663 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-18T00:33:58.661+0000 7fb5c4354640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33438) UID: 0 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102262 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 876544~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.145608104000004, 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053956648000000003, 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102262 2024-09-18T00:33:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.521209+0000", 2024-09-18T00:33:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522880+0000", 2024-09-18T00:33:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001670932 2024-09-18T00:33:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522885+0000", 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522897+0000", 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1717e-05 2024-09-18T00:33:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.522904+0000", 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574789+0000", 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.051885155000000002 2024-09-18T00:33:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.574862+0000", 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3116999999999998e-05 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.575166+0000", 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030338499999999998 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102420 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 983040~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.133882885999995, 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054254638000000001, 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102420 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532934+0000", 2024-09-18T00:33:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.29e-07 2024-09-18T00:33:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532936+0000", 2024-09-18T00:33:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1230000000000001e-06 2024-09-18T00:33:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532939+0000", 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.004e-06 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.532941+0000", 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.644e-06 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.585877+0000", 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052935589999999998 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586185+0000", 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030772999999999998 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587189+0000", 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010043179999999999 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102467 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 770048~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.13358959, 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053718169000000003, 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102467 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533227+0000", 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533350+0000", 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012240800000000001 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533353+0000", 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.88e-06 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533358+0000", 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.305e-06 2024-09-18T00:33:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533362+0000", 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.946e-06 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586778+0000", 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053415666000000001 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586858+0000", 2024-09-18T00:33:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0382000000000004e-05 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586946+0000", 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7582000000000003e-05 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102468 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 811008~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.133447423000007, 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053691079000000003, 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102468 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533370+0000", 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533638+0000", 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000268213 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533642+0000", 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4109999999999998e-06 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533653+0000", 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0628000000000001e-05 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533658+0000", 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.586961+0000", 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053303459999999997 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587002+0000", 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0958000000000003e-05 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587061+0000", 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8767000000000002e-05 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102469 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 851968~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.133145811999995, 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053711969999999998, 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102469 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.533671+0000", 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534878+0000", 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012066189999999999 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534882+0000", 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3839999999999999e-06 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534894+0000", 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1678000000000001e-05 2024-09-18T00:33:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.534901+0000", 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3710000000000002e-06 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587083+0000", 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052182053999999999 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587164+0000", 2024-09-18T00:33:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0532999999999996e-05 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.587383+0000", 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021933099999999999 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102536 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 786432~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.127676316000006, 2024-09-18T00:33:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053623704000000001, 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102536 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539141+0000", 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8400000000000005e-07 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539144+0000", 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2699999999999999e-06 2024-09-18T00:33:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539150+0000", 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2600000000000002e-06 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539155+0000", 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9370000000000003e-06 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592567+0000", 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053412764000000001 2024-09-18T00:33:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592664+0000", 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6786999999999993e-05 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592764+0000", 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100202 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102537 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 864256~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.127655755999996, 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053817140999999999, 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102537 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539161+0000", 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539162+0000", 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539164+0000", 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1289999999999999e-06 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539171+0000", 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9550000000000003e-06 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539176+0000", 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7849999999999999e-06 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592796+0000", 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053620639999999997 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592890+0000", 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3830000000000001e-05 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.592978+0000", 2024-09-18T00:33:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8387999999999995e-05 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102538 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 831488~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.127635264000006, 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053984011999999998, 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102538 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539182+0000", 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539184+0000", 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.238e-06 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539190+0000", 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9699999999999996e-06 2024-09-18T00:33:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539195+0000", 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6829999999999999e-06 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593006+0000", 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053810943999999999 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593079+0000", 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2616999999999999e-05 2024-09-18T00:33:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593166+0000", 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7151000000000006e-05 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102539 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 909312~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.127615817000006, 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054548265999999998, 2024-09-18T00:33:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102539 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539201+0000", 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539971+0000", 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076990999999999995 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539976+0000", 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8450000000000002e-06 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539985+0000", 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9020000000000005e-06 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.539992+0000", 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8700000000000003e-06 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593195+0000", 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05320279 2024-09-18T00:33:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593275+0000", 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0767999999999996e-05 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593750+0000", 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047418100000000001 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102541 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 950272~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.126792498, 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053747547, 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102541 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540025+0000", 2024-09-18T00:33:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.89e-07 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540027+0000", 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2350000000000002e-06 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540033+0000", 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.677e-06 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540038+0000", 2024-09-18T00:33:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7439999999999998e-06 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593594+0000", 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053555958000000001 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593666+0000", 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2788999999999997e-05 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593772+0000", 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010575500000000001 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102542 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.126773541999995, 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053915927000000002, 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102542 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540044+0000", 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4999999999999998e-07 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540046+0000", 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9429999999999999e-06 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540051+0000", 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6119999999999998e-06 2024-09-18T00:33:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540056+0000", 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240000000000003e-06 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593797+0000", 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053741034 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593869+0000", 2024-09-18T00:33:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1755000000000007e-05 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593959+0000", 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0809000000000004e-05 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102543 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 991232~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.126739822999994, 2024-09-18T00:33:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054089037, 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102543 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540077+0000", 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540078+0000", 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540081+0000", 2024-09-18T00:33:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.118e-06 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540087+0000", 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540092+0000", 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1200000000000001e-06 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.593984+0000", 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053891963000000001 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594058+0000", 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3980000000000007e-05 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594166+0000", 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108069 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102545 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 954368~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.126716361999996, 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054262986999999999, 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102545 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540101+0000", 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540103+0000", 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9800000000000001e-06 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540109+0000", 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0630000000000002e-06 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540114+0000", 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6789999999999996e-06 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594194+0000", 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054080431999999998 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594268+0000", 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3949999999999995e-05 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594364+0000", 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5512000000000003e-05 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102546 3.1f 3:fbcb10cb:::rbd_data.1197e53ff0cc.0000000000000000:23 [read 995328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.126696441999997, 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055467888, 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102546 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540121+0000", 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4200000000000002e-07 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540123+0000", 2024-09-18T00:33:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0250000000000001e-06 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540129+0000", 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9200000000000001e-06 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540134+0000", 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595277+0000", 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055143861000000002 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595363+0000", 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5950000000000002e-05 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595589+0000", 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022508399999999999 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102591 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 782336~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.126677443999995, 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054395407999999999, 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102591 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540140+0000", 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540887+0000", 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074690499999999996 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540891+0000", 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6269999999999999e-06 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540903+0000", 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.148e-05 2024-09-18T00:33:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540910+0000", 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9750000000000001e-06 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594391+0000", 2024-09-18T00:33:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053481292 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594465+0000", 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4274000000000001e-05 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594535+0000", 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9855000000000001e-05 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102593 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 823296~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.125894879000001, 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053779313000000002, 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102593 2024-09-18T00:33:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540922+0000", 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540923+0000", 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3300000000000002e-07 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540931+0000", 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540939+0000", 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8050000000000007e-06 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540945+0000", 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9270000000000002e-06 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594550+0000", 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053605672 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594597+0000", 2024-09-18T00:33:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6548999999999998e-05 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594702+0000", 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010451900000000001 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102595 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 864256~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.125864215000007, 2024-09-18T00:33:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053991152000000001, 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102595 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540953+0000", 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540955+0000", 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540962+0000", 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540968+0000", 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3839999999999996e-06 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594759+0000", 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053791931000000001 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594839+0000", 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9713000000000001e-05 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594944+0000", 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104829 2024-09-18T00:33:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102597 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 905216~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.125842555000006, 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054176152999999998, 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102597 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540975+0000", 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.72e-07 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540977+0000", 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.973e-06 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540983+0000", 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5300000000000002e-06 2024-09-18T00:33:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540989+0000", 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1819999999999997e-06 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.594969+0000", 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053980142000000002 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595049+0000", 2024-09-18T00:33:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0694999999999999e-05 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595151+0000", 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101259 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102598 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 786432~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.125822119999995, 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054647908000000002, 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102598 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.540995+0000", 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542878+0000", 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001883423 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542883+0000", 2024-09-18T00:33:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0699999999999997e-06 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542896+0000", 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2795e-05 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.542903+0000", 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0280000000000003e-06 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595177+0000", 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052274141000000003 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595493+0000", 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031601300000000003 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.595643+0000", 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000149438 2024-09-18T00:33:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:102610 3.17 3:ec2bbaf7:::rbd_data.1197e53ff0cc.0000000000000005:23 [read 913408~4096] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e70)", 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.123791483999995, 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053694878000000001, 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102610 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543026+0000", 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8000000000000001e-07 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543028+0000", 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0949999999999998e-06 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543034+0000", 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1380000000000004e-06 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.543039+0000", 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5059999999999997e-06 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596536+0000", 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053496907000000003 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596618+0000", 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2785000000000001e-05 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:40.596720+0000", 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102067 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:58.763 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:58.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T00:33:58.765 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-18T00:33:58.763+0000 7f9f49352640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33522) UID: 0 2024-09-18T00:33:58.845 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-18T00:33:58.865 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-18T00:33:58.864+0000 7f0827369640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33445) UID: 0 2024-09-18T00:33:58.920 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:58.920 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:58.920 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:58.920 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:58.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T00:33:58.930 INFO:teuthology.orchestra.run.smithi081.stdout:All operations completed A-OK! 2024-09-18T00:33:58.943 DEBUG:teuthology.parallel:result is None 2024-09-18T00:33:58.943 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-18T00:33:58.952 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-18T00:33:58.962 INFO:tasks.thrashosds:joining thrashosds 2024-09-18T00:33:59.033 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.033 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:59.033 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:59.033 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:59.033 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T00:33:59.145 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.145 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:59.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39871 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 140288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.674492985, 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017160774, 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39871 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468641+0000", 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8500000000000001e-07 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468646+0000", 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-06 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468654+0000", 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3209999999999999e-06 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468659+0000", 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3480000000000003e-06 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485644+0000", 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016984538 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485716+0000", 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2494000000000001e-05 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485801+0000", 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5326000000000003e-05 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39873 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 143360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67420226999999, 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017069841999999998, 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39873 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468931+0000", 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468932+0000", 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-06 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468938+0000", 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2719999999999997e-06 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468949+0000", 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1513e-05 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468957+0000", 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8120000000000008e-06 2024-09-18T00:33:59.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485828+0000", 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016870789000000001 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.485908+0000", 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0158000000000001e-05 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486001+0000", 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3269000000000004e-05 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39875 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 146432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67415581100001, 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017215481000000001, 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39875 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468978+0000", 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0999999999999999e-07 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468981+0000", 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468988+0000", 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2049999999999996e-06 2024-09-18T00:33:59.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.468994+0000", 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.682e-06 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486028+0000", 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017033735000000001 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486105+0000", 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7985999999999995e-05 2024-09-18T00:33:59.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486193+0000", 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7723e-05 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39878 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 149504~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67413231499999, 2024-09-18T00:33:59.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017411005, 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39878 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469001+0000", 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469002+0000", 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469004+0000", 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1890000000000001e-06 2024-09-18T00:33:59.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469012+0000", 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7800000000000001e-06 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469017+0000", 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2889999999999997e-06 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486219+0000", 2024-09-18T00:33:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017202041000000001 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486325+0000", 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106078 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486412+0000", 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7165999999999999e-05 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39880 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 152576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67410981, 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017581005, 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39880 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469024+0000", 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1600000000000002e-07 2024-09-18T00:33:59.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469027+0000", 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0230000000000001e-06 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469033+0000", 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.319e-06 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469038+0000", 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-18T00:33:59.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486438+0000", 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400064 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486516+0000", 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7989000000000002e-05 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486605+0000", 2024-09-18T00:33:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8415e-05 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39882 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 155648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67359986, 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017264956000000001, 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39882 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469534+0000", 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4700000000000001e-07 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469539+0000", 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.138e-06 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469547+0000", 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.901e-06 2024-09-18T00:33:59.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469567+0000", 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9978000000000001e-05 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486630+0000", 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017062483999999999 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486709+0000", 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9468999999999994e-05 2024-09-18T00:33:59.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486799+0000", 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9239000000000004e-05 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39884 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 158720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.673549772, 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017400407999999999, 2024-09-18T00:33:59.173 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39884 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469584+0000", 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4099999999999999e-07 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469588+0000", 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0260000000000001e-06 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469601+0000", 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2942000000000001e-05 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469607+0000", 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5419999999999996e-06 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486825+0000", 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017217716000000001 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486906+0000", 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1186999999999994e-05 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.486984+0000", 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8454000000000005e-05 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.177 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39886 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 161792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.673518402, 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017545139000000001, 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39886 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469615+0000", 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469616+0000", 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9399999999999995e-07 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469618+0000", 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.181e-06 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469625+0000", 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2640000000000002e-06 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469630+0000", 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1290000000000004e-06 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487009+0000", 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017378912 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487080+0000", 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0902999999999995e-05 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487160+0000", 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0255999999999999e-05 2024-09-18T00:33:59.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39888 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67349631499999, 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017709142000000001, 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39888 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469637+0000", 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469638+0000", 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.03e-07 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469640+0000", 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.097e-06 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469646+0000", 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5010000000000001e-06 2024-09-18T00:33:59.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469653+0000", 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6170000000000003e-06 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487189+0000", 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017536145 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487260+0000", 2024-09-18T00:33:59.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1415999999999995e-05 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487346+0000", 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5963000000000003e-05 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39890 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 167936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.673474277, 2024-09-18T00:33:59.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913602000000001, 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39890 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469659+0000", 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469660+0000", 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.15e-07 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469662+0000", 2024-09-18T00:33:59.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469667+0000", 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3299999999999998e-06 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.469672+0000", 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.724e-06 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487383+0000", 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017711264000000001 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487458+0000", 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4635999999999995e-05 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487573+0000", 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011514300000000001 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39894 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 174080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.67231225499999, 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017117306999999998, 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39894 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.191 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470821+0000", 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470822+0000", 2024-09-18T00:33:59.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.82e-07 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470824+0000", 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3870000000000002e-06 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470832+0000", 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6380000000000004e-06 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470838+0000", 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8300000000000001e-06 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487781+0000", 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016943237 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487851+0000", 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0438000000000006e-05 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487939+0000", 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7294999999999997e-05 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39895 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 177152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672280935, 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017267313999999999, 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39895 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470853+0000", 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3799999999999998e-07 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470855+0000", 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.373e-06 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470863+0000", 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1849999999999998e-06 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470868+0000", 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5550000000000002e-06 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.487965+0000", 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017096743000000001 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488038+0000", 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3374000000000006e-05 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488120+0000", 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1645999999999997e-05 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39897 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672249139, 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017410657, 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39897 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470884+0000", 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470885+0000", 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470887+0000", 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3520000000000001e-06 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470896+0000", 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7190000000000007e-06 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470902+0000", 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-18T00:33:59.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488147+0000", 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017245634999999999 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488219+0000", 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1588000000000006e-05 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488295+0000", 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-18T00:33:59.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39899 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 183296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672224028, 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017560052999999999, 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39899 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470910+0000", 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470912+0000", 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1720000000000001e-06 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470924+0000", 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2024e-05 2024-09-18T00:33:59.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470931+0000", 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3040000000000001e-06 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488321+0000", 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017390635000000002 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488395+0000", 2024-09-18T00:33:59.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3446000000000001e-05 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488470+0000", 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4949000000000004e-05 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39901 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672180561, 2024-09-18T00:33:59.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017702453999999999, 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39901 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470953+0000", 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470954+0000", 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2e-07 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470956+0000", 2024-09-18T00:33:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470963+0000", 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0310000000000001e-06 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470968+0000", 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488498+0000", 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017530273999999998 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488570+0000", 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1496999999999997e-05 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488655+0000", 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5767999999999996e-05 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39908 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 189440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672158674, 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017861741, 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39908 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.213 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470975+0000", 2024-09-18T00:33:59.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9500000000000003e-07 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470977+0000", 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9719999999999999e-06 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470983+0000", 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9909999999999999e-06 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.470988+0000", 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7280000000000003e-06 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488682+0000", 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017693871 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488754+0000", 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2402000000000002e-05 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488837+0000", 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2281999999999996e-05 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39910 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 192512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672101396, 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017971686000000001, 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39910 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471032+0000", 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471033+0000", 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471037+0000", 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2950000000000004e-06 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471045+0000", 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9030000000000004e-06 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471051+0000", 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488866+0000", 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017815004999999998 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.488941+0000", 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5872999999999997e-05 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489004+0000", 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2447999999999996e-05 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:39912 3.0 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:10 [read 195584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.672074307, 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018109588999999999, 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 39912 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471059+0000", 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471060+0000", 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3799999999999997e-07 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471062+0000", 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471068+0000", 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1029999999999998e-06 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.471073+0000", 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8749999999999999e-06 2024-09-18T00:33:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489034+0000", 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017960680999999999 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489109+0000", 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5414999999999995e-05 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.489169+0000", 2024-09-18T00:33:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9744000000000003e-05 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125309 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1851392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.341444268999993, 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017045714999999999, 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125309 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801689+0000", 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2399999999999999e-07 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801698+0000", 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7819999999999999e-06 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801702+0000", 2024-09-18T00:33:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8010000000000001e-06 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801705+0000", 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-06 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818652+0000", 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016947070000000002 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818696+0000", 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3849e-05 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818735+0000", 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9394000000000003e-05 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:125310 3.0 3:001f973a:::rbd_data.1197452c11c5.000000000000002a:2a [read 1998848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e77)", 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.341425240999996, 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017208972999999999, 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 125310 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801708+0000", 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801709+0000", 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3900000000000001e-07 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801710+0000", 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1260000000000001e-06 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801713+0000", 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0189999999999998e-06 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.801715+0000", 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4420000000000001e-06 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818757+0000", 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017041756000000002 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818837+0000", 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0022000000000001e-05 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:48.818917+0000", 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369000000000003e-05 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.235 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T00:33:59.339 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.339 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:59.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:59.339 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T00:33:59.451 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:59.451 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T00:33:59.564 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:33:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:33:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:33:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2194 3.4 e29/23 3:25ff69f2:::rbd_data.1197f1330e07.0000000000000079:head v 29'11, mlcod=28'9)", 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.026799092, 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004522819, 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535149+0000", 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535150+0000", 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.409e-06 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535163+0000", 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2208999999999999e-05 2024-09-18T00:33:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535183+0000", 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0801e-05 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535192+0000", 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1090000000000004e-06 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535251+0000", 2024-09-18T00:33:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8326999999999999e-05 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.535272+0000", 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1511000000000001e-05 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539624+0000", 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043518539999999996 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.539672+0000", 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7599000000000003e-05 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2414 3.0 e29/23 3:031f607f:::rbd_data.1197f1330e07.00000000000000a6:head v 29'12, mlcod=29'9)", 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.882412636, 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050634800000000004, 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679535+0000", 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679536+0000", 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4000000000000001e-07 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679541+0000", 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1379999999999998e-06 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679553+0000", 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1416e-05 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679559+0000", 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2659999999999998e-06 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679603+0000", 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.384e-05 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.679621+0000", 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8216e-05 2024-09-18T00:33:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684559+0000", 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049379749999999998 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.684599+0000", 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9988999999999999e-05 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:2475 3.9 e29/23 3:97e76923:::rbd_data.1197f1330e07.0000000000000230:head v 29'53, mlcod=29'51)", 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.85709580699999, 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042795300000000001, 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704852+0000", 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704853+0000", 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2500000000000005e-07 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704859+0000", 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6230000000000002e-06 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704875+0000", 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6548000000000001e-05 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704883+0000", 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704935+0000", 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2391e-05 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.704957+0000", 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1851000000000001e-05 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709095+0000", 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041374460000000004 2024-09-18T00:33:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:52.709132+0000", 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7196000000000001e-05 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16324 3.4 e39/23 3:226bb5e1:::rbd_data.1197c78141c8.0000000000000006:head v 39'69, mlcod=39'67)", 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.65452270199999, 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052747080000000003, 2024-09-18T00:33:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907425+0000", 2024-09-18T00:33:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907426+0000", 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6800000000000001e-07 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907434+0000", 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2020000000000004e-06 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907444+0000", 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0400999999999999e-05 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907453+0000", 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2279999999999998e-06 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907515+0000", 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2852000000000001e-05 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907534+0000", 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8872000000000002e-05 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912668+0000", 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051337149999999996 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912700+0000", 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1970000000000001e-05 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16327 3.0 e39/23 3:06ffc745:::rbd_data.1197c78141c8.0000000000000009:head v 39'57, mlcod=39'54)", 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.65436641700001, 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051368619999999999, 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907582+0000", 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.16e-07 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907589+0000", 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4389999999999997e-06 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907599+0000", 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907606+0000", 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7850000000000003e-06 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907699+0000", 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3195000000000005e-05 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907717+0000", 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7414999999999998e-05 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912692+0000", 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049759219999999998 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912718+0000", 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6044999999999999e-05 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:16325 3.4 e39/23 3:258bc8e7:::rbd_data.1197c78141c8.0000000000000007:head v 39'70, mlcod=39'67)", 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.654182093, 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051696729999999996, 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907766+0000", 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8699999999999995e-07 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907772+0000", 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2379999999999997e-06 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907780+0000", 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8079999999999994e-06 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907786+0000", 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9139999999999996e-06 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907836+0000", 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9224999999999997e-05 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.907853+0000", 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7552999999999999e-05 2024-09-18T00:33:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912898+0000", 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050449689999999998 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:02.912936+0000", 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24057 3.0 e42/23 3:03674f00:::rbd_data.1197d40ae3ec.000000000000009b:head v 42'120, mlcod=41'116)", 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.53606374, 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047270419999999999, 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025884+0000", 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025885+0000", 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1500000000000004e-07 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025891+0000", 2024-09-18T00:33:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8680000000000004e-06 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025903+0000", 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2644e-05 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025911+0000", 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3499999999999999e-06 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025952+0000", 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1498999999999997e-05 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.025965+0000", 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245999999999999e-05 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030577+0000", 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046124950000000003 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:07.030611+0000", 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4325000000000001e-05 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24570 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'132, mlcod=43'129)", 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.377890318, 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049838089999999996, 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184058+0000", 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184059+0000", 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7700000000000003e-07 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184066+0000", 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1010000000000003e-06 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184079+0000", 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3162999999999999e-05 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184086+0000", 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0559999999999999e-06 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184133+0000", 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7435999999999998e-05 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.184155+0000", 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1486000000000001e-05 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.188988+0000", 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048329319999999999 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.189042+0000", 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3758000000000003e-05 2024-09-18T00:33:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24571 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'133, mlcod=43'130)", 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.37691238399999, 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066859629999999996, 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185036+0000", 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999996e-07 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185042+0000", 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4040000000000003e-06 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185053+0000", 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1589e-05 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185059+0000", 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.801e-06 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186188+0000", 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011289220000000001 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186204+0000", 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5569e-05 2024-09-18T00:33:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191687+0000", 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054831990000000002 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191722+0000", 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4795999999999997e-05 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:24572 3.4 e43/23 3:24839a98:::rbd_object_map.11976d82ec76:head v 43'134, mlcod=43'130)", 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.376185772, 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005974839, 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185762+0000", 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185763+0000", 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4000000000000001e-07 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185768+0000", 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3430000000000003e-06 2024-09-18T00:33:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185780+0000", 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1377e-05 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.185786+0000", 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3389999999999998e-06 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186473+0000", 2024-09-18T00:33:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00068661899999999997 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.186491+0000", 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8790000000000001e-05 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191724+0000", 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052323600000000001 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:08.191737+0000", 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3271000000000001e-05 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30413 3.0 e46/23 3:067fb2c4:::rbd_data.1197cee1465b.0000000000000126:head v 46'135, mlcod=45'132)", 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.492339007, 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069992839999999997, 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069609+0000", 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.53e-07 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069620+0000", 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-18T00:33:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069634+0000", 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4543e-05 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069641+0000", 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3949999999999998e-06 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069700+0000", 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9194000000000003e-05 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.069719+0000", 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8828999999999999e-05 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076565+0000", 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068465770000000004 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.076608+0000", 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3108999999999997e-05 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30417 3.4 e46/23 3:2324a4dc:::rbd_data.1197cee1465b.00000000000001ca:head v 46'183, mlcod=45'180)", 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.491297117, 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089167629999999994, 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070651+0000", 2024-09-18T00:33:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070652+0000", 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000003e-07 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070657+0000", 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9799999999999998e-06 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070666+0000", 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4199999999999996e-06 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070671+0000", 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070716+0000", 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5435999999999997e-05 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.070733+0000", 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6725999999999999e-05 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079528+0000", 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087953370000000003 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079568+0000", 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9369000000000002e-05 2024-09-18T00:33:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:30421 3.4 e46/23 3:26c7dfe4:::rbd_data.1197cee1465b.00000000000001ce:head v 46'185, mlcod=45'180)", 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.48627243, 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042325979999999997, 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075676+0000", 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2399999999999997e-07 2024-09-18T00:33:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075683+0000", 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.46e-06 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075695+0000", 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2629000000000001e-05 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075703+0000", 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2570000000000001e-06 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075745+0000", 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1912000000000001e-05 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.075762+0000", 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6999000000000001e-05 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079870+0000", 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041081629999999997 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:11.079908+0000", 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8454000000000001e-05 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:41393 3.9 e47/23 3:969d0e03:::rbd_data.1197120e014.0000000000000089:head v 47'170, mlcod=47'166)", 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.947054646, 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054564829999999998, 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614893+0000", 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614894+0000", 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9199999999999999e-07 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614909+0000", 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4456e-05 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614922+0000", 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3540000000000001e-05 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.614929+0000", 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.618e-06 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615351+0000", 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042248299999999997 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.615372+0000", 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1053999999999999e-05 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620304+0000", 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049311540000000001 2024-09-18T00:33:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:12.620350+0000", 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6285999999999997e-05 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:60818 3.4 e54/23 3:21431b30:::rbd_data.1197b17b4359.0000000000000294:head v 54'272, mlcod=54'270)", 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 98.517430152000003, 2024-09-18T00:33:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006137572, 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044518+0000", 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044519+0000", 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4e-07 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044548+0000", 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9152000000000001e-05 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044561+0000", 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.255e-05 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044568+0000", 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2280000000000001e-06 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044627+0000", 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9380999999999999e-05 2024-09-18T00:33:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.044647+0000", 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9395e-05 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050601+0000", 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059541960000000001 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:21.050655+0000", 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-05 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:115554 3.0 e74/23 3:053f65b7:::rbd_data.11976f9fa92d.0000000000000003:head v 74'300, mlcod=72'297)", 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.317185300999995, 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048359559999999998, 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244763+0000", 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8100000000000002e-07 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244771+0000", 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9869999999999999e-06 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244783+0000", 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2018000000000001e-05 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244791+0000", 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5440000000000001e-06 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244845+0000", 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-09-18T00:33:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.244867+0000", 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1988999999999999e-05 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249557+0000", 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046900350000000004 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:44.249599+0000", 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1242999999999998e-05 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4503.0:126344 3.9 e78/23 3:907dbfa6:::rbd_object_map.1197e5527c9e:head v 78'317, mlcod=78'313)", 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.215224078999995, 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046829929999999999, 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346724+0000", 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346725+0000", 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4600000000000004e-07 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346731+0000", 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0020000000000003e-06 2024-09-18T00:33:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346742+0000", 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1711e-05 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346749+0000", 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.528e-06 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346814+0000", 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4567999999999996e-05 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.346833+0000", 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9619e-05 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351355+0000", 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045219609999999997 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:32:49.351407+0000", 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1857999999999997e-05 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.4.0:1859 3.9 e131/23 3:91d130a7:::rbd_data.1197cee1465b.0000000000000008:10 v 131'495, mlcod=129'491)", 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.629854388, 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041144670000000001, 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932094+0000", 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.27e-07 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932099+0000", 2024-09-18T00:33:59.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2209999999999996e-06 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932107+0000", 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9419999999999995e-06 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932124+0000", 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6416999999999999e-05 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932176+0000", 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2562999999999998e-05 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932197+0000", 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0528999999999999e-05 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.936161+0000", 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039646580000000002 2024-09-18T00:33:59.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.936208+0000", 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6810000000000001e-05 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.4.0:1860 3.9 e131/23 3:95346bbc:::rbd_data.1197cee1465b.0000000000000059:10 v 131'497, mlcod=129'491)", 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.629153801999999, 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062238270000000004, 2024-09-18T00:33:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932794+0000", 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932795+0000", 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5000000000000002e-07 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932803+0000", 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0790000000000001e-06 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932813+0000", 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7710000000000001e-06 2024-09-18T00:33:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932819+0000", 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9000000000000003e-06 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932865+0000", 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6223000000000001e-05 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.932886+0000", 2024-09-18T00:33:59.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1458999999999999e-05 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.938973+0000", 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060871420000000002 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:44.939018+0000", 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4603e-05 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(osd.1.0:1679 3.4 e135/23 3:23a0225a:::rbd_data.119755f34769.0000000000000009:c v 135'593, mlcod=132'587)", 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 10.77031938, 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045316699999999998, 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791629+0000", 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8599999999999998e-07 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791634+0000", 2024-09-18T00:33:59.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7809999999999996e-06 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791641+0000", 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9290000000000001e-06 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.791645+0000", 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0500000000000002e-06 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:33:59.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.792177+0000", 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053202700000000002 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.792197+0000", 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9899e-05 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.796115+0000", 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039178759999999998 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:33:59.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:48.796160+0000", 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5621999999999998e-05 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:33:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T00:33:59.768 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.768 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:59.768 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-18T00:33:59.768 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T00:33:59.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T00:33:59.881 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:33:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-18T00:33:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-18T00:33:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-18T00:33:59.882 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:33:59.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5082 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.071558858, 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054330760999999998, 2024-09-18T00:34:00.041 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5082 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967124+0000", 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967447+0000", 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032283399999999998 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967452+0000", 2024-09-18T00:34:00.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2740000000000001e-06 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967461+0000", 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5210000000000008e-06 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967467+0000", 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0190000000000003e-06 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021250+0000", 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053783330999999997 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021342+0000", 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1749000000000005e-05 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021455+0000", 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113033 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5084 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 241664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.07117920100001, 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054384865999999997, 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5084 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.967504+0000", 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968237+0000", 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00073243400000000001 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968241+0000", 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968250+0000", 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1519999999999998e-06 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.968258+0000", 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021685+0000", 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053427699000000002 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021778+0000", 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2960000000000004e-05 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.021889+0000", 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011069300000000001 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5141 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.063565415, 2024-09-18T00:34:00.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054429758000000002, 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5141 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975118+0000", 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9299999999999998e-07 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975121+0000", 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.277e-06 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975127+0000", 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3489999999999997e-06 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975132+0000", 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5839999999999996e-06 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029370+0000", 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054238218999999997 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029450+0000", 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0275e-05 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029548+0000", 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7460999999999994e-05 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5142 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 329728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.063544949, 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054673793999999998, 2024-09-18T00:34:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5142 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975138+0000", 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975139+0000", 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2599999999999998e-07 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975146+0000", 2024-09-18T00:34:00.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4109999999999999e-06 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975153+0000", 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7329999999999997e-06 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975156+0000", 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.252e-06 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029614+0000", 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054458207000000002 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029700+0000", 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5718999999999997e-05 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029812+0000", 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112046 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5143 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.06352086, 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054947320000000001, 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5143 2024-09-18T00:34:00.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.975162+0000", 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976879+0000", 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017169170000000001 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976884+0000", 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9690000000000002e-06 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976894+0000", 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2650000000000002e-06 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.976900+0000", 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8619999999999997e-06 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.029857+0000", 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052956058 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030003+0000", 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014621100000000001 2024-09-18T00:34:00.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.030110+0000", 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107038 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5149 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.06167489800001, 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433671000000003, 2024-09-18T00:34:00.064 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5149 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977008+0000", 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977009+0000", 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0199999999999998e-07 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977015+0000", 2024-09-18T00:34:00.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977020+0000", 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6110000000000001e-06 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977032+0000", 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1849e-05 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031268+0000", 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054235945000000001 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031348+0000", 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9492000000000004e-05 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031442+0000", 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4464999999999998e-05 2024-09-18T00:34:00.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5150 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 559104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.061611079, 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054520566999999999, 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5150 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977072+0000", 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977073+0000", 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000005e-07 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977076+0000", 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.79e-06 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977083+0000", 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6399999999999997e-06 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977088+0000", 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031479+0000", 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054391030999999999 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031529+0000", 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9938999999999997e-05 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031593+0000", 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3428000000000003e-05 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5151 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 587776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.061582199, 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054717865999999997, 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5151 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977101+0000", 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977102+0000", 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7899999999999999e-07 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977104+0000", 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977110+0000", 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3969999999999999e-06 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977119+0000", 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7290000000000006e-06 2024-09-18T00:34:00.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031636+0000", 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054516756 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031721+0000", 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5354999999999998e-05 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031819+0000", 2024-09-18T00:34:00.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7958e-05 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5152 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 616448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.06155722299999, 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054874076000000001, 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5152 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977126+0000", 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977127+0000", 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9200000000000001e-07 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977129+0000", 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2330000000000001e-06 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977135+0000", 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2450000000000003e-06 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977140+0000", 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031866+0000", 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054726562999999999 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.031942+0000", 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5797999999999995e-05 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032000+0000", 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8233999999999998e-05 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5153 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 645120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:34:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.061538171, 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055109524, 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5153 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.977145+0000", 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978880+0000", 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735337 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978894+0000", 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3200999999999999e-05 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978930+0000", 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483000000000003e-05 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.978941+0000", 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1055e-05 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032059+0000", 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.053117711999999997 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032151+0000", 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2039000000000004e-05 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.032255+0000", 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010369699999999999 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5159 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 817152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.059589374, 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054378816000000003, 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5159 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979094+0000", 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0600000000000001e-07 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979096+0000", 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.074e-06 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979103+0000", 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3679999999999998e-06 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979109+0000", 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5899999999999996e-06 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033261+0000", 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054152052999999999 2024-09-18T00:34:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033353+0000", 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1812999999999997e-05 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033473+0000", 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119512 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5160 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 845824~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.059566917, 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054506668000000001, 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5160 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979116+0000", 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979117+0000", 2024-09-18T00:34:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.44e-07 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979119+0000", 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.334e-06 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979126+0000", 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.754e-06 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979131+0000", 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2460000000000003e-06 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033514+0000", 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054382699999999999 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033562+0000", 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7822999999999999e-05 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033623+0000", 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1266999999999995e-05 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5161 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 874496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.059538477, 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054721526999999999, 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5161 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979145+0000", 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2300000000000001e-07 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979148+0000", 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979155+0000", 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9990000000000002e-06 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979160+0000", 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0000000000000004e-06 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033664+0000", 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054504590999999998 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033759+0000", 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4899000000000001e-05 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033866+0000", 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010696699999999999 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5162 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 903168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.05951616900001, 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054934563999999998, 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5162 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979167+0000", 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979168+0000", 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3399999999999999e-07 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979170+0000", 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.221e-06 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979176+0000", 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5780000000000004e-06 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979181+0000", 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7690000000000004e-06 2024-09-18T00:34:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033904+0000", 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054722328000000001 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.033992+0000", 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8603999999999994e-05 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034102+0000", 2024-09-18T00:34:00.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010953 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5163 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 931840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.059495717, 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055141127999999998, 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.105 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5163 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979188+0000", 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979963+0000", 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00077510600000000002 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979968+0000", 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3000000000000001e-06 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979980+0000", 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2038999999999999e-05 2024-09-18T00:34:00.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.979988+0000", 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5900000000000002e-06 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034135+0000", 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054147595 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034223+0000", 2024-09-18T00:34:00.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8267e-05 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034329+0000", 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105231 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5164 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 960512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.058666268, 2024-09-18T00:34:00.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054464506000000003, 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5164 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980017+0000", 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980018+0000", 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6400000000000002e-07 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980028+0000", 2024-09-18T00:34:00.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0302000000000001e-05 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980042+0000", 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321000000000001e-05 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980049+0000", 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034369+0000", 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054320699 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034419+0000", 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9280999999999998e-05 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034482+0000", 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3027999999999994e-05 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5165 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 989184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.058625343, 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054677323, 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5165 2024-09-18T00:34:00.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980058+0000", 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980059+0000", 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4199999999999996e-07 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980061+0000", 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980083+0000", 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2561e-05 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980089+0000", 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034523+0000", 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054433373 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034632+0000", 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010910500000000001 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034735+0000", 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103355 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5166 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1017856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.058584096, 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054794194999999997, 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5166 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980099+0000", 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980100+0000", 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5599999999999995e-07 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980102+0000", 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.599e-06 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980109+0000", 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0550000000000002e-06 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980115+0000", 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034775+0000", 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054660133999999999 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034825+0000", 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0584000000000002e-05 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034893+0000", 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8189999999999996e-05 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:5167 3.8 3:100d27b1:::rbd_data.1197ce767b07.0000000000000002:4 [read 1046528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.058561431, 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055032177000000002, 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 5167 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980122+0000", 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980893+0000", 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000770932 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980897+0000", 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.34e-06 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980909+0000", 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1955e-05 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:53.980925+0000", 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5415000000000001e-05 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.034948+0000", 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054023074999999997 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035040+0000", 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2872000000000001e-05 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:31:54.035154+0000", 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113588 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4503.0:158858 3.5 3:a5c4e244:::rbd_object_map.11971d10eecb:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.142293123000002, 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0129964899999999, 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4503", 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 158858 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896390+0000", 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896392+0000", 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4810000000000001e-06 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896398+0000", 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4609999999999996e-06 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896411+0000", 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2662e-05 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896417+0000", 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896470+0000", 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2574999999999997e-05 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.896475+0000", 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1699999999999996e-06 2024-09-18T00:34:00.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899257+0000", 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027825520000000002 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:38.899265+0000", 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0970000000000006e-06 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904153+0000", 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0048876250000001 2024-09-18T00:34:00.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.904421+0000", 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026751299999999998 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909303+0000", 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004882061 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909339+0000", 2024-09-18T00:34:00.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6464000000000002e-05 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-18T00:33:39.909387+0000", 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589000000000001e-05 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-18T00:34:00.133 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:00.134 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T00:34:00.250 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:00.250 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:00.250 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:34:00.250 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:00.259 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T00:34:00.362 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:00.362 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:00.362 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:34:00.363 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:34:00.363 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:00.371 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T00:34:00.477 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32826 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 202752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.32981875599999, 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073537816000000006, 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.478 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32826 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:34:00.479 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144745+0000", 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4900000000000001e-07 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144748+0000", 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2560000000000001e-06 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144754+0000", 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0859999999999998e-06 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144759+0000", 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0509999999999996e-06 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218124+0000", 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073365207000000002 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218198+0000", 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3745999999999995e-05 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218283+0000", 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5020999999999998e-05 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.482 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32827 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329798293, 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073715486999999996, 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32827 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.483 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144765+0000", 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144766+0000", 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7099999999999997e-07 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144768+0000", 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0849999999999999e-06 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144774+0000", 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2750000000000001e-06 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144779+0000", 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9629999999999997e-06 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218312+0000", 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073532565999999994 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218384+0000", 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2342999999999995e-05 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218481+0000", 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6884000000000003e-05 2024-09-18T00:34:00.486 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32829 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 208896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329778898, 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073897975000000005, 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.487 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32829 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144785+0000", 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144787+0000", 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.888e-06 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144793+0000", 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0120000000000002e-06 2024-09-18T00:34:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144798+0000", 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7169999999999999e-06 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218518+0000", 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073720509000000004 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218593+0000", 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4548000000000005e-05 2024-09-18T00:34:00.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218683+0000", 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9889000000000006e-05 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32831 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 211968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329759743, 2024-09-18T00:34:00.491 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074067937, 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32831 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144804+0000", 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6600000000000002e-07 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144806+0000", 2024-09-18T00:34:00.493 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.773e-06 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144812+0000", 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3450000000000002e-06 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144817+0000", 2024-09-18T00:34:00.494 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8219999999999997e-06 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218711+0000", 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.073893654000000003 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.495 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218783+0000", 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2249000000000006e-05 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218872+0000", 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8727999999999995e-05 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32833 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 215040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.496 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329740313, 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074243727999999995, 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32833 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.497 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144823+0000", 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144824+0000", 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5900000000000003e-07 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.498 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144826+0000", 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.967e-06 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144832+0000", 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.28e-06 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144837+0000", 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0629999999999996e-06 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218907+0000", 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074070404000000006 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.218978+0000", 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0963000000000005e-05 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219067+0000", 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8691999999999997e-05 2024-09-18T00:34:00.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32834 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 218112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329720658, 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074408620999999994, 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.501 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32834 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.502 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144843+0000", 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6300000000000001e-07 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144845+0000", 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.778e-06 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144851+0000", 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2609999999999999e-06 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144856+0000", 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9810000000000003e-06 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219095+0000", 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074238530999999996 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219168+0000", 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2760000000000001e-05 2024-09-18T00:34:00.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219252+0000", 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3947000000000001e-05 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32836 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 221184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329701664, 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074671986999999995, 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.505 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32836 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144862+0000", 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9799999999999999e-07 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144873+0000", 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1088e-05 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144887+0000", 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3811e-05 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144893+0000", 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6330000000000001e-06 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219280+0000", 2024-09-18T00:34:00.508 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074386856000000001 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219354+0000", 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4101000000000001e-05 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219534+0000", 2024-09-18T00:34:00.509 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00018009999999999999 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32838 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 224256~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329662739, 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074817597, 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32838 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144901+0000", 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5200000000000002e-07 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144904+0000", 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.311e-06 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.512 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144910+0000", 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5459999999999997e-06 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144915+0000", 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5950000000000001e-06 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219568+0000", 2024-09-18T00:34:00.513 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074652866999999998 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219637+0000", 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9692999999999998e-05 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219719+0000", 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1132999999999997e-05 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.514 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32840 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329642659, 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074981560000000003, 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.515 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32840 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.516 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144921+0000", 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144923+0000", 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9080000000000002e-06 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144930+0000", 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.5409999999999997e-06 2024-09-18T00:34:00.517 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144935+0000", 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.882e-06 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219746+0000", 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074810838000000004 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219814+0000", 2024-09-18T00:34:00.518 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8717e-05 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219903+0000", 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8252999999999997e-05 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32845 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 230400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329622915, 2024-09-18T00:34:00.519 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075149530000000006, 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32845 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.520 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144941+0000", 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.521 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144943+0000", 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.934e-06 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144949+0000", 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.3579999999999999e-06 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144954+0000", 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9830000000000004e-06 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.522 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.219932+0000", 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.074977917000000005 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220006+0000", 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3438999999999999e-05 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220090+0000", 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4504000000000003e-05 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32847 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 233472~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329603136, 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075487213999999997, 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.524 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32847 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.525 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144961+0000", 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9499999999999998e-07 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144963+0000", 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8589999999999999e-06 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144969+0000", 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4869999999999999e-06 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.526 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144974+0000", 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5430000000000004e-06 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220120+0000", 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075145760000000006 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220352+0000", 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00023242200000000001 2024-09-18T00:34:00.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220448+0000", 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5748000000000006e-05 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32848 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 236544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329583548, 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075661351000000002, 2024-09-18T00:34:00.528 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32848 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144980+0000", 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144981+0000", 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1199999999999998e-07 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144983+0000", 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0040000000000002e-06 2024-09-18T00:34:00.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.144997+0000", 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3974e-05 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145002+0000", 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5890000000000002e-06 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.531 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220478+0000", 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075476215999999999 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220553+0000", 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5137999999999998e-05 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220641+0000", 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8017999999999997e-05 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.532 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32850 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 239616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329554082, 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075849117999999993, 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.533 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32850 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.534 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145010+0000", 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0200000000000002e-07 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145017+0000", 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3730000000000004e-06 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145024+0000", 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.781e-06 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145029+0000", 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1329999999999998e-06 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220682+0000", 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075652725000000004 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220759+0000", 2024-09-18T00:34:00.536 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6982000000000003e-05 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220859+0000", 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9622000000000003e-05 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32852 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 242688~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329523749, 2024-09-18T00:34:00.537 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076025702000000001, 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32852 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145040+0000", 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9999999999999998e-07 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145042+0000", 2024-09-18T00:34:00.539 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0619999999999999e-06 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145049+0000", 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.251e-06 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145059+0000", 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0839000000000001e-05 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.540 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220897+0000", 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.075837142999999996 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.220972+0000", 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5791000000000007e-05 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221066+0000", 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.3215999999999997e-05 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.541 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32854 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 245760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329497019, 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076231599999999997, 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32854 2024-09-18T00:34:00.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.543 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145067+0000", 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7100000000000002e-07 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145069+0000", 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1399999999999998e-06 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145076+0000", 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.46e-06 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.544 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145087+0000", 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0883999999999999e-05 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221126+0000", 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076039148000000001 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221206+0000", 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0656999999999997e-05 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.545 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221298+0000", 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1840000000000002e-05 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32856 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329469622, 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076382481000000002, 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.546 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32856 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.547 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145094+0000", 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145095+0000", 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2200000000000004e-07 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145097+0000", 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6230000000000001e-06 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.548 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145108+0000", 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0606e-05 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145113+0000", 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7779999999999998e-06 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221332+0000", 2024-09-18T00:34:00.549 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076219502999999994 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221394+0000", 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1990999999999997e-05 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221477+0000", 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2458000000000002e-05 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32858 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 251904~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329443979, 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076543195999999994, 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32858 2024-09-18T00:34:00.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145120+0000", 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145125+0000", 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9790000000000001e-06 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145127+0000", 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4880000000000001e-06 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145132+0000", 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1590000000000001e-06 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145137+0000", 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221500+0000", 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076363383000000007 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221572+0000", 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1222000000000004e-05 2024-09-18T00:34:00.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221663+0000", 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1272000000000003e-05 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32860 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 254976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329419073, 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076717667000000003, 2024-09-18T00:34:00.555 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32860 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145145+0000", 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145150+0000", 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.557 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145153+0000", 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.548e-06 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145162+0000", 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5359999999999992e-06 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145166+0000", 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.904e-06 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.558 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221693+0000", 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076526315999999997 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221762+0000", 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9141999999999996e-05 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221862+0000", 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000100337 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.559 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32862 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 258048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329384902, 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076893835999999993, 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.560 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32862 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145179+0000", 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2100000000000002e-07 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145190+0000", 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0530000000000001e-05 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145197+0000", 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2470000000000002e-06 2024-09-18T00:34:00.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145209+0000", 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2308e-05 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221898+0000", 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076688606000000006 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.221975+0000", 2024-09-18T00:34:00.563 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.6773000000000005e-05 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222073+0000", 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7950999999999998e-05 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:32864 3.1a 3:5b536e69:::rbd_data.1197cee1465b.0000000000000002:10 [read 261120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 108.329346982, 2024-09-18T00:34:00.564 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076988231000000004, 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 32864 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145217+0000", 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.96e-07 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145219+0000", 2024-09-18T00:34:00.566 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1220000000000002e-06 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145225+0000", 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4190000000000001e-06 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.145229+0000", 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.567 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222104+0000", 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.076874447999999998 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222151+0000", 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.744e-05 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.568 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:12.222205+0000", 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3582999999999998e-05 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.569 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:00.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T00:34:00.673 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:00.674 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:00.674 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:34:00.674 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:00.682 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T00:34:00.786 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:00.786 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:00.786 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:34:00.786 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:34:00.786 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:00.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T00:34:00.863 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-18T00:34:00.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T00:34:00.900 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1726 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 272384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.54047512899999, 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045997705999999999, 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.901 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1726 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.902 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358061+0000", 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358883+0000", 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00082231800000000005 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358887+0000", 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2610000000000004e-06 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.903 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358897+0000", 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4939999999999992e-06 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.358905+0000", 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5140000000000001e-06 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.403958+0000", 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045052544999999999 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.904 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404005+0000", 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7045000000000001e-05 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.404058+0000", 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3529000000000002e-05 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1815 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 733184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.905 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.53138686700001, 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045987785000000003, 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1815 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.906 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367149+0000", 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.37e-07 2024-09-18T00:34:00.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367152+0000", 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.5189999999999999e-06 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367160+0000", 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8739999999999995e-06 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367165+0000", 2024-09-18T00:34:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5500000000000002e-06 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.412950+0000", 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784843999999998 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413040+0000", 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.9574999999999995e-05 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.909 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413137+0000", 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6885999999999994e-05 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1816 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.53136249900001, 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093398000000001, 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.910 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1816 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367173+0000", 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367174+0000", 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367175+0000", 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.5990000000000001e-06 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.912 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367179+0000", 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6959999999999998e-06 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367182+0000", 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.728e-06 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413157+0000", 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045974913999999999 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.913 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413207+0000", 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0447e-05 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413267+0000", 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9636999999999998e-05 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1817 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 790528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.914 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.53134991900001, 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046237589000000003, 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1817 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.915 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367186+0000", 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.4600000000000001e-07 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.916 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367187+0000", 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1489999999999999e-06 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367190+0000", 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1729999999999999e-06 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367193+0000", 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6419999999999999e-06 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413305+0000", 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046112248000000002 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413369+0000", 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4082000000000001e-05 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413423+0000", 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4048999999999997e-05 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.918 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1818 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 819200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.531339643, 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352271, 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1818 2024-09-18T00:34:00.919 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.367196+0000", 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.920 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368880+0000", 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0016841639999999999 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368884+0000", 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.41e-06 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368894+0000", 2024-09-18T00:34:00.921 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0122999999999999e-05 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.368901+0000", 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8870000000000003e-06 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.922 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413451+0000", 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044549898999999997 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413497+0000", 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6585999999999997e-05 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.413548+0000", 2024-09-18T00:34:00.923 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1202000000000002e-05 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1953 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 565248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51948545900001, 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046085418000000003, 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.924 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1953 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379050+0000", 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379051+0000", 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1800000000000001e-07 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379053+0000", 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379059+0000", 2024-09-18T00:34:00.926 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7049999999999996e-06 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379064+0000", 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8490000000000002e-06 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.424957+0000", 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045892751000000002 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.927 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425041+0000", 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3344999999999996e-05 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425136+0000", 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5239000000000001e-05 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1954 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 593920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:34:00.928 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51946508899999, 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046171538999999998, 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1954 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.929 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.379071+0000", 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380883+0000", 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001812201 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380887+0000", 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0570000000000003e-06 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380895+0000", 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8909999999999995e-06 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.380901+0000", 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.9889999999999997e-06 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425150+0000", 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044249014000000003 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425191+0000", 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0877000000000002e-05 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.425242+0000", 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.151e-05 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.932 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1964 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 880640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51750545199999, 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046009109999999999, 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.933 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1964 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381030+0000", 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.934 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.03e-07 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381031+0000", 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5199999999999995e-07 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381034+0000", 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9210000000000001e-06 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.935 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381037+0000", 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.418e-06 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426923+0000", 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045886109000000001 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.426984+0000", 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.1023999999999997e-05 2024-09-18T00:34:00.936 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427039+0000", 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5482999999999997e-05 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:1965 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 909312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51749618299999, 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046209999000000002, 2024-09-18T00:34:00.937 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 1965 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.938 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.381040+0000", 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382882+0000", 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018419910000000001 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382886+0000", 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2130000000000002e-06 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.939 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382897+0000", 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1409999999999999e-05 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.382904+0000", 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0469999999999996e-06 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427072+0000", 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044168115000000001 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.940 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427152+0000", 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.9120000000000001e-05 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.427250+0000", 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8103000000000006e-05 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2012 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 194560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.941 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51548288199999, 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046156984999999998, 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2012 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.942 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383053+0000", 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5999999999999999e-07 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383055+0000", 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8700000000000001e-06 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383061+0000", 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.5720000000000002e-06 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383065+0000", 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5990000000000004e-06 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.944 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429006+0000", 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045940328000000002 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429103+0000", 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.7192000000000001e-05 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429210+0000", 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000107064 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.945 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2013 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.515464721, 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046352632999999997, 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.946 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2013 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.383071+0000", 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384881+0000", 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0018102210000000001 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384886+0000", 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3889999999999998e-06 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384897+0000", 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1527e-05 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.384905+0000", 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5159999999999997e-06 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429250+0000", 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044345127999999998 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429333+0000", 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2684999999999999e-05 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.429424+0000", 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1167000000000003e-05 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2022 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 481280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51316683799999, 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045995709000000003, 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.950 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2022 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.951 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385369+0000", 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0900000000000002e-07 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385383+0000", 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3988000000000001e-05 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.952 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385395+0000", 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1871999999999999e-05 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385401+0000", 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7880000000000003e-06 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431185+0000", 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045784077999999999 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.953 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431268+0000", 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2657000000000005e-05 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431365+0000", 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6916999999999994e-05 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2023 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.954 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51312638799999, 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046154747000000003, 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2023 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:34:00.955 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385409+0000", 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385481+0000", 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.2087000000000003e-05 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.956 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385486+0000", 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3309999999999997e-06 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385493+0000", 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8900000000000001e-06 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385497+0000", 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5709999999999999e-06 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431402+0000", 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045904905000000003 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431476+0000", 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.3497999999999993e-05 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431564+0000", 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8465000000000001e-05 2024-09-18T00:34:00.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2024 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 538624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51303089199999, 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046277466000000003, 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.959 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2024 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.385505+0000", 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.960 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386881+0000", 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001376033 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386885+0000", 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1590000000000003e-06 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386897+0000", 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1484000000000001e-05 2024-09-18T00:34:00.961 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.386904+0000", 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8439999999999998e-06 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431603+0000", 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044698630000000003 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431686+0000", 2024-09-18T00:34:00.962 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2698e-05 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.431782+0000", 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6618000000000002e-05 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2031 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 739328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51145516700001, 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046100033999999998, 2024-09-18T00:34:00.963 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2031 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.964 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387081+0000", 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0100000000000005e-07 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387083+0000", 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.984e-06 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.965 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387090+0000", 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.584e-06 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387094+0000", 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6929999999999998e-06 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433003+0000", 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045908141999999999 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.966 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433089+0000", 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6868999999999998e-05 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433181+0000", 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1261000000000006e-05 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.967 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2032 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 768000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51143444900001, 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046199573000000001, 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2032 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.968 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387101+0000", 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387102+0000", 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1399999999999997e-07 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387103+0000", 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7400000000000001e-06 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387111+0000", 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1500000000000002e-06 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387116+0000", 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2170000000000002e-06 2024-09-18T00:34:00.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433209+0000", 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046093502000000001 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433250+0000", 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0651000000000001e-05 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433301+0000", 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0899000000000002e-05 2024-09-18T00:34:00.971 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2033 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 796672~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.51141091599999, 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046390235000000002, 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.972 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2033 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387125+0000", 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.72e-07 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387127+0000", 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8369999999999999e-06 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387134+0000", 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.0140000000000001e-06 2024-09-18T00:34:00.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387140+0000", 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8850000000000004e-06 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433340+0000", 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046200089999999999 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.975 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433423+0000", 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.3245999999999995e-05 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433515+0000", 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.1791000000000003e-05 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2034 3.a 3:5132a6e0:::rbd_data.1197ce767b07.0000000000000009:4 [read 825344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.976 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.511388318, 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.046487582999999999, 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2034 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:34:00.977 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.387147+0000", 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388881+0000", 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001733875 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.978 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388889+0000", 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.8320000000000006e-06 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388899+0000", 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.9680000000000001e-06 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.388906+0000", 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.6780000000000003e-06 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.979 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433543+0000", 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.044637476000000002 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433584+0000", 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0528999999999998e-05 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.433635+0000", 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.1224999999999998e-05 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.980 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:2045 3.a 3:5197f2d0:::rbd_data.1197f1330e07.0000000000000039:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 184320~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 128.509432761, 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.047207091999999999, 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 2045 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.981 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389103+0000", 2024-09-18T00:34:00.982 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.77e-07 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389432+0000", 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00032880300000000002 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389439+0000", 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.1579999999999999e-06 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.389443+0000", 2024-09-18T00:34:00.983 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.0099999999999997e-06 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434808+0000", 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.045364740000000001 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.434918+0000", 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000109509 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:34:00.984 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.435119+0000", 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000201139 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436082+0000", 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00096345600000000001 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436246+0000", 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00016343099999999999 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.985 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436279+0000", 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.3476000000000003e-05 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:31:52.436310+0000", 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0993e-05 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.986 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:156379 3.a 3:51f6e3de:::rbd_data.1197d85df63.0000000000000022:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 39.047138103999998, 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.93035060199999997, 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 156379 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:00.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851398+0000", 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851400+0000", 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.945e-06 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851408+0000", 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.2719999999999997e-06 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851428+0000", 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.031e-05 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851438+0000", 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.6479999999999998e-06 2024-09-18T00:34:00.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851512+0000", 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.4019999999999999e-05 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for peered", 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:21.851523+0000", 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.145e-05 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779503+0000", 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.92797969400000002 2024-09-18T00:34:00.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779638+0000", 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00013492800000000001 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "waiting for subops from 4", 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.779739+0000", 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010061899999999999 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "sub_op_commit_rec", 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781662+0000", 2024-09-18T00:34:00.991 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001923063 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "op_commit", 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781680+0000", 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.8848e-05 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "commit_sent", 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781718+0000", 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.7240999999999998e-05 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:33:22.781748+0000", 2024-09-18T00:34:00.992 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0564000000000001e-05 2024-09-18T00:34:00.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:00.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:00.993 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:00.994 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T00:34:01.098 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:01.098 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:01.098 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:34:01.098 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:01.108 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T00:34:01.212 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:01.212 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:01.212 INFO:teuthology.orchestra.run.smithi167.stdout: "complaint_time": 30, 2024-09-18T00:34:01.212 INFO:teuthology.orchestra.run.smithi167.stdout: "num_blocked_ops": 0 2024-09-18T00:34:01.213 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:01.221 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T00:34:01.325 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 20, 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 600, 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [ 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132850 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1816576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.736324957999997, 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050509075, 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.326 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132850 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587246+0000", 2024-09-18T00:34:01.327 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587247+0000", 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.58e-07 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587249+0000", 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.928e-06 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.328 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587253+0000", 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2239999999999997e-06 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587257+0000", 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3209999999999998e-06 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637618+0000", 2024-09-18T00:34:01.329 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050361072 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637688+0000", 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.9764999999999994e-05 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637755+0000", 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.7407e-05 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.330 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132854 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1925120~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.736259773, 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050657580000000001, 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132854 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.331 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587312+0000", 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.332 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587400+0000", 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.8059000000000005e-05 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587405+0000", 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3129999999999998e-06 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587412+0000", 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.5689999999999999e-06 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.333 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587419+0000", 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2219999999999999e-06 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637794+0000", 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050375615999999998 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637875+0000", 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.0432999999999994e-05 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.334 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.637969+0000", 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.4368000000000002e-05 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132855 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1953792~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.736142862999998, 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050754372999999998, 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.335 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132855 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.336 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.587428+0000", 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588882+0000", 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.001453108 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.337 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588886+0000", 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4379999999999997e-06 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588894+0000", 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7009999999999996e-06 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.588899+0000", 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8230000000000002e-06 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.338 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638010+0000", 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049111800999999997 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638096+0000", 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.5539999999999998e-05 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.638183+0000", 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.6961999999999999e-05 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.339 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132879 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1849344~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.734432052000002, 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050648138000000002, 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.340 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132879 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589139+0000", 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.341 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589140+0000", 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6899999999999997e-07 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589142+0000", 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.894e-06 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589147+0000", 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7189999999999998e-06 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.342 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.589152+0000", 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7269999999999998e-06 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639669+0000", 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050517152000000003 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639719+0000", 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9579000000000001e-05 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.343 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.639787+0000", 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.8497999999999994e-05 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132911 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1882112~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.732284500999995, 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050567506999999998, 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.344 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132911 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.591287+0000", 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592883+0000", 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00159658 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592887+0000", 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.5420000000000001e-06 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592901+0000", 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3909e-05 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.592906+0000", 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.4709999999999998e-06 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641756+0000", 2024-09-18T00:34:01.347 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.048849586 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641797+0000", 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1090999999999997e-05 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.641854+0000", 2024-09-18T00:34:01.348 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7327999999999997e-05 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132933 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1767424~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.730500449000004, 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050661246, 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.349 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132933 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:34:01.350 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593071+0000", 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.6399999999999998e-07 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593072+0000", 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.046e-06 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.351 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593075+0000", 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0149999999999999e-06 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593078+0000", 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6809999999999998e-06 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643552+0000", 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050474059000000002 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.352 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643637+0000", 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.4892e-05 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643732+0000", 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.5189e-05 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132937 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1875968~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.353 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.730464412999993, 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0507629, 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132937 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:34:01.354 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593107+0000", 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.2000000000000001e-07 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.355 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593108+0000", 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1069999999999999e-06 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593111+0000", 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9909999999999998e-06 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593114+0000", 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9040000000000001e-06 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.356 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643765+0000", 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050650805 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643812+0000", 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7533e-05 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643870+0000", 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7340000000000003e-05 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.357 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132938 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1904640~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.730454218999995, 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050925972999999999, 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132938 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.358 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593117+0000", 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.0499999999999999e-07 2024-09-18T00:34:01.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593118+0000", 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0499999999999999e-06 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593121+0000", 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9730000000000002e-06 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.360 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593124+0000", 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.6180000000000002e-06 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643939+0000", 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050815144999999999 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.643986+0000", 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6909000000000001e-05 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.361 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644043+0000", 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6972999999999998e-05 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132941 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1914880~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.730444375000005, 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051139469999999999, 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.362 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132941 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:34:01.363 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593127+0000", 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.1300000000000001e-07 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593128+0000", 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.8700000000000004e-07 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.364 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593131+0000", 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.9620000000000002e-06 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.593134+0000", 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7779999999999999e-06 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644081+0000", 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050946894999999999 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.365 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644163+0000", 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1849999999999997e-05 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.644266+0000", 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.00010368499999999999 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.366 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132964 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1800192~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728331939, 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050524093999999999, 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132964 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.367 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595239+0000", 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595240+0000", 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7300000000000001e-07 2024-09-18T00:34:01.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595242+0000", 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.3719999999999999e-06 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595248+0000", 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.2079999999999997e-06 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595265+0000", 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.6867999999999998e-05 2024-09-18T00:34:01.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645660+0000", 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050394311999999997 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645708+0000", 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7941000000000001e-05 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645763+0000", 2024-09-18T00:34:01.370 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.592e-05 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132968 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1908736~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728238169999997, 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050572789999999999, 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.371 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132968 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595333+0000", 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595334+0000", 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3500000000000002e-07 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595336+0000", 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9850000000000001e-06 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595341+0000", 2024-09-18T00:34:01.373 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8540000000000002e-06 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595346+0000", 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8910000000000003e-06 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645792+0000", 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050445928000000001 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645841+0000", 2024-09-18T00:34:01.374 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8887999999999997e-05 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645906+0000", 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4808999999999996e-05 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132969 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1937408~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728217481000001, 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050757440000000001, 2024-09-18T00:34:01.375 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132969 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595354+0000", 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7399999999999999e-07 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595356+0000", 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.7209999999999999e-06 2024-09-18T00:34:01.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595361+0000", 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.6749999999999999e-06 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595366+0000", 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8550000000000001e-06 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.645943+0000", 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050576659000000003 2024-09-18T00:34:01.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646021+0000", 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 7.7572999999999997e-05 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646111+0000", 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 9.0682999999999999e-05 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132972 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1947648~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728198696000007, 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050868295000000001, 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132972 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595373+0000", 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8500000000000002e-07 2024-09-18T00:34:01.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595375+0000", 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0320000000000002e-06 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595381+0000", 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8479999999999997e-06 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595386+0000", 2024-09-18T00:34:01.382 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.8099999999999997e-06 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646141+0000", 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050755430999999997 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646187+0000", 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5930000000000002e-05 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646241+0000", 2024-09-18T00:34:01.383 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3859000000000001e-05 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132976 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 2056192~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728124625999996, 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050930792000000003, 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.384 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132976 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:34:01.385 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595447+0000", 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1300000000000001e-07 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595449+0000", 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.0260000000000002e-06 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.386 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595455+0000", 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0639999999999999e-06 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595460+0000", 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.746e-06 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646279+0000", 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050819061999999998 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.387 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646331+0000", 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2429000000000002e-05 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646377+0000", 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.6051999999999999e-05 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132977 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2084864~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.388 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728105173000003, 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051018414999999998, 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132977 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:34:01.389 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595466+0000", 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595467+0000", 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9200000000000002e-07 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595469+0000", 2024-09-18T00:34:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.1110000000000002e-06 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595474+0000", 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8279999999999999e-06 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595479+0000", 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0320000000000003e-06 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.391 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646402+0000", 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050922373 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646445+0000", 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3250000000000001e-05 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646485+0000", 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.9428999999999998e-05 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.392 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132978 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 2095104~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.728085809000007, 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051108661, 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132978 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.393 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595485+0000", 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595486+0000", 2024-09-18T00:34:01.394 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.8200000000000001e-07 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595488+0000", 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9580000000000001e-06 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595494+0000", 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7969999999999997e-06 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.395 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595499+0000", 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.9540000000000003e-06 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646508+0000", 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051008959 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646553+0000", 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.5459e-05 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.396 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646594+0000", 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1152000000000002e-05 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132982 3.e 3:750bf2d1:::rbd_data.1197452c11c5.0000000000000002:2a [read 1646592~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.727911759999998, 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051052526000000001, 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132982 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:34:01.398 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595660+0000", 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.0500000000000003e-07 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.399 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595663+0000", 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 2.7030000000000002e-06 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595671+0000", 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 8.1720000000000007e-06 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595682+0000", 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.1017e-05 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.400 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646617+0000", 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050934672 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646659+0000", 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.1998e-05 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646712+0000", 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3359000000000002e-05 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132983 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1675264~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.727881394999997, 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.051140942000000002, 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132983 2024-09-18T00:34:01.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.595690+0000", 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.403 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596885+0000", 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.0011948239999999999 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596889+0000", 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.4490000000000001e-06 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596902+0000", 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.2597e-05 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.404 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.596915+0000", 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.3586e-05 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646735+0000", 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.049819819000000001 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.405 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646778+0000", 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.3186999999999998e-05 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.646831+0000", 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.2479999999999999e-05 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.406 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:132999 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1970176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.726434527999999, 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050526475000000001, 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 132999 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.407 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597137+0000", 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 3.4499999999999998e-07 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.408 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597139+0000", 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.829e-06 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597145+0000", 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.7139999999999998e-06 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597155+0000", 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.0693000000000001e-05 2024-09-18T00:34:01.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647495+0000", 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050339522999999997 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647559+0000", 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 6.4171999999999995e-05 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647663+0000", 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.000104199 2024-09-18T00:34:01.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "description": "osd_op(client.4503.0:133002 3.e 3:7170bcd8:::rbd_data.1197452c11c5.0000000000000001:2a [read 1980416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e79)", 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "initiated_at": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "age": 70.726409068999999, 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050610850999999998, 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "continuous": false, 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "type_data": { 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "flag_point": "started", 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client_info": { 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client": "client.4503", 2024-09-18T00:34:01.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client_addr": "172.21.15.81:0/1657740561", 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "tid": 133002 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "events": [ 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "initiated", 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "header_read", 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597162+0000", 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.412 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "throttled", 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597163+0000", 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.3000000000000001e-07 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "all_read", 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597165+0000", 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 1.9819999999999998e-06 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "dispatched", 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597171+0000", 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.8839999999999999e-06 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "queued_for_pg", 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.597175+0000", 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.7190000000000001e-06 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "reached_pg", 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647680+0000", 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 0.050504924999999999 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "started", 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647723+0000", 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 4.2391000000000001e-05 2024-09-18T00:34:01.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: "event": "done", 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2024-09-18T00:32:50.647773+0000", 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: "duration": 5.0420000000000002e-05 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-18T00:34:01.415 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-18T00:34:03.861 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-18T00:34:03.862 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-09-18T00:34:03.862 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-18T00:34:03.862 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-18T00:34:03.865 INFO:tasks.ceph.osd.5:Started 2024-09-18T00:34:03.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:no valid command found; 10 closest matches: 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:0 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:1 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:2 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:abort 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:assert 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:config diff 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:config diff get 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:config get 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:config help [] 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:config set ... 2024-09-18T00:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:admin_socket: invalid command 2024-09-18T00:34:03.977 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T00:34:03.977 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-18T00:34:05.052 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:34:05.050+0000 7f7944615640 -1 Falling back to public interface 2024-09-18T00:34:08.647 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:34:08.645+0000 7f7944615640 -1 osd.5 124 log_to_monitors true 2024-09-18T00:34:08.902 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-18T00:34:08.900+0000 7f7937d15640 -1 osd.5 124 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T00:34:08.979 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T00:34:09.083 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-18T00:34:09.083 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": [], 2024-09-18T00:34:09.083 INFO:teuthology.orchestra.run.smithi167.stdout: "num_ops": 0 2024-09-18T00:34:09.083 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-18T00:34:09.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-18T00:34:09.214 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a: {} 2024-09-18T00:34:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T00:34:09.225 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b: {} 2024-09-18T00:34:09.225 INFO:teuthology.orchestra.run.smithi081.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T00:34:09.232 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c: {} 2024-09-18T00:34:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T00:34:09.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T00:34:09.889 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T00:34:09.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-18T00:34:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-18T00:34:10.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T00:34:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T00:34:11.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-18T00:34:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-18T00:34:12.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T00:34:13.911 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T00:34:13.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-18T00:34:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-18T00:34:14.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T00:34:15.941 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T00:34:15.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-18T00:34:16.937 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-18T00:34:16.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T00:34:17.944 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T00:34:17.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-18T00:34:18.956 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-18T00:34:18.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T00:34:19.960 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T00:34:19.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-18T00:34:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-18T00:34:20.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T00:34:21.782 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T00:34:21.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-18T00:34:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-18T00:34:22.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T00:34:23.989 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T00:34:24.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-18T00:34:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-18T00:34:25.012 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-18T00:34:25.012 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-18T00:34:25.012 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-18T00:34:25.012 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-18T00:34:25.012 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T00:34:25.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T00:34:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:25.296 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":164,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:34:24.988354+0000","last_up_change":"2024-09-18T00:34:09.887078+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T00:31:29.068996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T00:31:35.737341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-18T00:31:45.237398+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":52,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6813","nonce":1726163291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6817","nonce":1726163291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6825","nonce":1726163291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6819","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6821","nonce":1726163291}]},"public_addr":"172.21.15.81:6813/1726163291","cluster_addr":"172.21.15.81:6817/1726163291","heartbeat_back_addr":"172.21.15.81:6825/1726163291","heartbeat_front_addr":"172.21.15.81:6821/1726163291","state":["exists","up"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6825","nonce":2008948201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6827","nonce":2008948201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6831","nonce":2008948201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6829","nonce":2008948201}]},"public_addr":"172.21.15.167:6825/2008948201","cluster_addr":"172.21.15.167:6827/2008948201","heartbeat_back_addr":"172.21.15.167:6831/2008948201","heartbeat_front_addr":"172.21.15.167:6829/2008948201","state":["exists","up"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":124,"up_from":149,"up_thru":149,"down_at":125,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6817","nonce":1730328106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6819","nonce":1730328106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6823","nonce":1730328106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6821","nonce":1730328106}]},"public_addr":"172.21.15.167:6817/1730328106","cluster_addr":"172.21.15.167:6819/1730328106","heartbeat_back_addr":"172.21.15.167:6823/1730328106","heartbeat_front_addr":"172.21.15.167:6821/1730328106","state":["exists","up"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6801","nonce":2657673991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6803","nonce":2657673991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6807","nonce":2657673991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6805","nonce":2657673991}]},"public_addr":"172.21.15.167:6801/2657673991","cluster_addr":"172.21.15.167:6803/2657673991","heartbeat_back_addr":"172.21.15.167:6807/2657673991","heartbeat_front_addr":"172.21.15.167:6805/2657673991","state":["exists","up"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6809","nonce":2652298701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6811","nonce":2652298701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6815","nonce":2652298701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6813","nonce":2652298701}]},"public_addr":"172.21.15.167:6809/2652298701","cluster_addr":"172.21.15.167:6811/2652298701","heartbeat_back_addr":"172.21.15.167:6815/2652298701","heartbeat_front_addr":"172.21.15.167:6813/2652298701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.022758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:27.126737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.574908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.569036+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.436338+0000","dead_epoch":125},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.050552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.299077+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.10","osds":[1,4]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:34:25.309 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T00:34:25.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T00:34:25.586 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:25.587 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":164,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:34:24.988354+0000","last_up_change":"2024-09-18T00:34:09.887078+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T00:31:29.068996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T00:31:35.737341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-18T00:31:45.237398+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":52,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6813","nonce":1726163291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6817","nonce":1726163291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6825","nonce":1726163291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6819","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6821","nonce":1726163291}]},"public_addr":"172.21.15.81:6813/1726163291","cluster_addr":"172.21.15.81:6817/1726163291","heartbeat_back_addr":"172.21.15.81:6825/1726163291","heartbeat_front_addr":"172.21.15.81:6821/1726163291","state":["exists","up"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6825","nonce":2008948201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6827","nonce":2008948201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6831","nonce":2008948201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6829","nonce":2008948201}]},"public_addr":"172.21.15.167:6825/2008948201","cluster_addr":"172.21.15.167:6827/2008948201","heartbeat_back_addr":"172.21.15.167:6831/2008948201","heartbeat_front_addr":"172.21.15.167:6829/2008948201","state":["exists","up"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":124,"up_from":149,"up_thru":149,"down_at":125,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6817","nonce":1730328106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6819","nonce":1730328106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6823","nonce":1730328106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6821","nonce":1730328106}]},"public_addr":"172.21.15.167:6817/1730328106","cluster_addr":"172.21.15.167:6819/1730328106","heartbeat_back_addr":"172.21.15.167:6823/1730328106","heartbeat_front_addr":"172.21.15.167:6821/1730328106","state":["exists","up"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6801","nonce":2657673991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6803","nonce":2657673991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6807","nonce":2657673991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6805","nonce":2657673991}]},"public_addr":"172.21.15.167:6801/2657673991","cluster_addr":"172.21.15.167:6803/2657673991","heartbeat_back_addr":"172.21.15.167:6807/2657673991","heartbeat_front_addr":"172.21.15.167:6805/2657673991","state":["exists","up"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6809","nonce":2652298701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6811","nonce":2652298701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6815","nonce":2652298701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6813","nonce":2652298701}]},"public_addr":"172.21.15.167:6809/2652298701","cluster_addr":"172.21.15.167:6811/2652298701","heartbeat_back_addr":"172.21.15.167:6815/2652298701","heartbeat_front_addr":"172.21.15.167:6813/2652298701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.022758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:27.126737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.574908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.569036+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.436338+0000","dead_epoch":125},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.050552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.299077+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.10","osds":[1,4]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:34:25.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T00:34:25.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T00:34:25.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T00:34:25.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T00:34:25.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T00:34:25.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T00:34:25.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T00:34:25.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T00:34:25.842 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:25.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T00:34:25.846 INFO:teuthology.orchestra.run.smithi081.stdout:55834574886 2024-09-18T00:34:25.847 INFO:teuthology.orchestra.run.smithi081.stdout:60129542183 2024-09-18T00:34:25.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T00:34:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:60129542183 2024-09-18T00:34:25.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T00:34:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:25.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T00:34:25.849 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:25.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T00:34:25.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T00:34:25.851 INFO:teuthology.orchestra.run.smithi081.stdout:639950127109 2024-09-18T00:34:25.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T00:34:25.852 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:25.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T00:34:26.398 INFO:teuthology.orchestra.run.smithi081.stdout:64424509477 2024-09-18T00:34:26.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509477 for osd.1 2024-09-18T00:34:26.445 INFO:teuthology.orchestra.run.smithi081.stdout:64424509477 2024-09-18T00:34:26.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509477 for osd.7 2024-09-18T00:34:26.472 INFO:teuthology.orchestra.run.smithi081.stdout:60129542182 2024-09-18T00:34:26.476 INFO:teuthology.orchestra.run.smithi081.stdout:60129542182 2024-09-18T00:34:26.482 INFO:teuthology.orchestra.run.smithi081.stdout:55834574885 2024-09-18T00:34:26.485 INFO:teuthology.orchestra.run.smithi081.stdout:64424509477 2024-09-18T00:34:26.487 INFO:teuthology.orchestra.run.smithi081.stdout:64424509477 2024-09-18T00:34:26.487 INFO:teuthology.orchestra.run.smithi081.stdout:639950127108 2024-09-18T00:34:26.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.2 2024-09-18T00:34:26.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.3 2024-09-18T00:34:26.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574886 got 55834574885 for osd.0 2024-09-18T00:34:26.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509477 for osd.6 2024-09-18T00:34:26.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 639950127109 got 639950127108 for osd.5 2024-09-18T00:34:26.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509477 for osd.4 2024-09-18T00:34:27.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T00:34:27.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T00:34:27.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T00:34:27.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T00:34:27.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T00:34:27.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T00:34:27.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T00:34:27.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T00:34:27.938 INFO:teuthology.orchestra.run.smithi081.stdout:64424509477 2024-09-18T00:34:27.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509477 for osd.1 2024-09-18T00:34:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:28.026 INFO:teuthology.orchestra.run.smithi081.stdout:60129542183 2024-09-18T00:34:28.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.7 2024-09-18T00:34:28.040 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.3 2024-09-18T00:34:28.044 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.053 INFO:teuthology.orchestra.run.smithi081.stdout:55834574886 2024-09-18T00:34:28.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574886 got 55834574886 for osd.0 2024-09-18T00:34:28.065 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:60129542183 2024-09-18T00:34:28.093 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:28.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.2 2024-09-18T00:34:28.101 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.6 2024-09-18T00:34:28.108 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.117 INFO:teuthology.orchestra.run.smithi081.stdout:639950127109 2024-09-18T00:34:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:28.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 639950127109 got 639950127109 for osd.5 2024-09-18T00:34:28.131 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.4 2024-09-18T00:34:28.134 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:28.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T00:34:29.243 INFO:teuthology.orchestra.run.smithi081.stdout:64424509479 2024-09-18T00:34:29.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509479 got 64424509479 for osd.1 2024-09-18T00:34:29.257 DEBUG:teuthology.parallel:result is None 2024-09-18T00:34:29.257 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T00:34:29.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:29.532 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:29.543 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-18T00:34:29.068736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20732,"ondisk_log_size":20732,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369444,"kb_used_data":15452,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605276,"statfs":{"total":773094113280,"available":772715802624,"internally_reserved":0,"allocated":15822848,"data_stored":8744927,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088127"},"pg_stats":[{"pgid":"3.1f","version":"151'540","reported_seq":6064,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475897+0000","last_change":"2024-09-18T00:34:11.968109+0000","last_active":"2024-09-18T00:34:25.475897+0000","last_peered":"2024-09-18T00:34:25.475897+0000","last_clean":"2024-09-18T00:34:25.475897+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:25.475897+0000","last_undegraded":"2024-09-18T00:34:25.475897+0000","last_fullsized":"2024-09-18T00:34:25.475897+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:45.083482+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"143'619","reported_seq":4297,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817153+0000","last_change":"2024-09-18T00:33:58.914896+0000","last_active":"2024-09-18T00:34:25.817153+0000","last_peered":"2024-09-18T00:34:25.817153+0000","last_clean":"2024-09-18T00:34:25.817153+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:25.817153+0000","last_undegraded":"2024-09-18T00:34:25.817153+0000","last_fullsized":"2024-09-18T00:34:25.817153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:11.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"150'622","reported_seq":6838,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816129+0000","last_change":"2024-09-18T00:34:10.990561+0000","last_active":"2024-09-18T00:34:25.816129+0000","last_peered":"2024-09-18T00:34:25.816129+0000","last_clean":"2024-09-18T00:34:25.816129+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:25.816129+0000","last_undegraded":"2024-09-18T00:34:25.816129+0000","last_fullsized":"2024-09-18T00:34:25.816129+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:45.279057+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"150'791","reported_seq":6596,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816177+0000","last_change":"2024-09-18T00:34:11.109534+0000","last_active":"2024-09-18T00:34:25.816177+0000","last_peered":"2024-09-18T00:34:25.816177+0000","last_clean":"2024-09-18T00:34:25.816177+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:25.816177+0000","last_undegraded":"2024-09-18T00:34:25.816177+0000","last_fullsized":"2024-09-18T00:34:25.816177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:41.803194+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"143'851","reported_seq":4070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475836+0000","last_change":"2024-09-18T00:34:11.899310+0000","last_active":"2024-09-18T00:34:25.475836+0000","last_peered":"2024-09-18T00:34:25.475836+0000","last_clean":"2024-09-18T00:34:25.475836+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:25.475836+0000","last_undegraded":"2024-09-18T00:34:25.475836+0000","last_fullsized":"2024-09-18T00:34:25.475836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:41.721082+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"145'429","reported_seq":10537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992627+0000","last_change":"2024-09-18T00:33:58.847282+0000","last_active":"2024-09-18T00:34:24.992627+0000","last_peered":"2024-09-18T00:34:24.992627+0000","last_clean":"2024-09-18T00:34:24.992627+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:24.992627+0000","last_undegraded":"2024-09-18T00:34:24.992627+0000","last_fullsized":"2024-09-18T00:34:24.992627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:47.743442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"143'733","reported_seq":2759,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991697+0000","last_change":"2024-09-18T00:33:58.843733+0000","last_active":"2024-09-18T00:34:24.991697+0000","last_peered":"2024-09-18T00:34:24.991697+0000","last_clean":"2024-09-18T00:34:24.991697+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:24.991697+0000","last_undegraded":"2024-09-18T00:34:24.991697+0000","last_fullsized":"2024-09-18T00:34:24.991697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:06.718931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"143'451","reported_seq":6055,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817376+0000","last_change":"2024-09-18T00:33:58.915285+0000","last_active":"2024-09-18T00:34:25.817376+0000","last_peered":"2024-09-18T00:34:25.817376+0000","last_clean":"2024-09-18T00:34:25.817376+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:25.817376+0000","last_undegraded":"2024-09-18T00:34:25.817376+0000","last_fullsized":"2024-09-18T00:34:25.817376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:01.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'1057","reported_seq":5231,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475939+0000","last_change":"2024-09-18T00:34:11.943349+0000","last_active":"2024-09-18T00:34:25.475939+0000","last_peered":"2024-09-18T00:34:25.475939+0000","last_clean":"2024-09-18T00:34:25.475939+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:25.475939+0000","last_undegraded":"2024-09-18T00:34:25.475939+0000","last_fullsized":"2024-09-18T00:34:25.475939+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:21:17.217607+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"150'681","reported_seq":3578,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816179+0000","last_change":"2024-09-18T00:34:11.024249+0000","last_active":"2024-09-18T00:34:25.816179+0000","last_peered":"2024-09-18T00:34:25.816179+0000","last_clean":"2024-09-18T00:34:25.816179+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:25.816179+0000","last_undegraded":"2024-09-18T00:34:25.816179+0000","last_fullsized":"2024-09-18T00:34:25.816179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:31.836839+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"145'618","reported_seq":5715,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232119+0000","last_change":"2024-09-18T00:33:58.855576+0000","last_active":"2024-09-18T00:34:25.232119+0000","last_peered":"2024-09-18T00:34:25.232119+0000","last_clean":"2024-09-18T00:34:25.232119+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:25.232119+0000","last_undegraded":"2024-09-18T00:34:25.232119+0000","last_fullsized":"2024-09-18T00:34:25.232119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:47.459464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"143'471","reported_seq":6472,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992548+0000","last_change":"2024-09-18T00:33:58.846364+0000","last_active":"2024-09-18T00:34:24.992548+0000","last_peered":"2024-09-18T00:34:24.992548+0000","last_clean":"2024-09-18T00:34:24.992548+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:24.992548+0000","last_undegraded":"2024-09-18T00:34:24.992548+0000","last_fullsized":"2024-09-18T00:34:24.992548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:19.394023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370994+0000","last_change":"2024-09-18T00:33:22.779457+0000","last_active":"2024-09-18T00:34:25.370994+0000","last_peered":"2024-09-18T00:34:25.370994+0000","last_clean":"2024-09-18T00:34:25.370994+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:25.370994+0000","last_undegraded":"2024-09-18T00:34:25.370994+0000","last_fullsized":"2024-09-18T00:34:25.370994+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:32.956130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'367","reported_seq":2490,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475890+0000","last_change":"2024-09-18T00:33:58.875581+0000","last_active":"2024-09-18T00:34:25.475890+0000","last_peered":"2024-09-18T00:34:25.475890+0000","last_clean":"2024-09-18T00:34:25.475890+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:25.475890+0000","last_undegraded":"2024-09-18T00:34:25.475890+0000","last_fullsized":"2024-09-18T00:34:25.475890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:26.615195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991955+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:34:24.991955+0000","last_peered":"2024-09-18T00:34:24.991955+0000","last_clean":"2024-09-18T00:34:24.991955+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:24.991955+0000","last_undegraded":"2024-09-18T00:34:24.991955+0000","last_fullsized":"2024-09-18T00:34:24.991955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"144'541","reported_seq":3815,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817270+0000","last_change":"2024-09-18T00:33:58.915231+0000","last_active":"2024-09-18T00:34:25.817270+0000","last_peered":"2024-09-18T00:34:25.817270+0000","last_clean":"2024-09-18T00:34:25.817270+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:25.817270+0000","last_undegraded":"2024-09-18T00:34:25.817270+0000","last_fullsized":"2024-09-18T00:34:25.817270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:15:00.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232230+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:34:25.232230+0000","last_peered":"2024-09-18T00:34:25.232230+0000","last_clean":"2024-09-18T00:34:25.232230+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:25.232230+0000","last_undegraded":"2024-09-18T00:34:25.232230+0000","last_fullsized":"2024-09-18T00:34:25.232230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"145'604","reported_seq":4126,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991748+0000","last_change":"2024-09-18T00:33:58.844330+0000","last_active":"2024-09-18T00:34:24.991748+0000","last_peered":"2024-09-18T00:34:24.991748+0000","last_clean":"2024-09-18T00:34:24.991748+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:24.991748+0000","last_undegraded":"2024-09-18T00:34:24.991748+0000","last_fullsized":"2024-09-18T00:34:24.991748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:38:44.367873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991859+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:34:24.991859+0000","last_peered":"2024-09-18T00:34:24.991859+0000","last_clean":"2024-09-18T00:34:24.991859+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:24.991859+0000","last_undegraded":"2024-09-18T00:34:24.991859+0000","last_fullsized":"2024-09-18T00:34:24.991859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'1052","reported_seq":5279,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816126+0000","last_change":"2024-09-18T00:34:11.145910+0000","last_active":"2024-09-18T00:34:25.816126+0000","last_peered":"2024-09-18T00:34:25.816126+0000","last_clean":"2024-09-18T00:34:25.816126+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:25.816126+0000","last_undegraded":"2024-09-18T00:34:25.816126+0000","last_fullsized":"2024-09-18T00:34:25.816126+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:23.247998+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"145'644","reported_seq":3564,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992505+0000","last_change":"2024-09-18T00:33:58.848118+0000","last_active":"2024-09-18T00:34:24.992505+0000","last_peered":"2024-09-18T00:34:24.992505+0000","last_clean":"2024-09-18T00:34:24.992505+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:24.992505+0000","last_undegraded":"2024-09-18T00:34:24.992505+0000","last_fullsized":"2024-09-18T00:34:24.992505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:48.142039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":227,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816105+0000","last_change":"2024-09-18T00:34:10.900377+0000","last_active":"2024-09-18T00:34:25.816105+0000","last_peered":"2024-09-18T00:34:25.816105+0000","last_clean":"2024-09-18T00:34:25.816105+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:25.816105+0000","last_undegraded":"2024-09-18T00:34:25.816105+0000","last_fullsized":"2024-09-18T00:34:25.816105+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:16.361358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"143'429","reported_seq":2440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991742+0000","last_change":"2024-09-18T00:33:58.844266+0000","last_active":"2024-09-18T00:34:24.991742+0000","last_peered":"2024-09-18T00:34:24.991742+0000","last_clean":"2024-09-18T00:34:24.991742+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:24.991742+0000","last_undegraded":"2024-09-18T00:34:24.991742+0000","last_fullsized":"2024-09-18T00:34:24.991742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:00.303484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992564+0000","last_change":"2024-09-18T00:34:16.067443+0000","last_active":"2024-09-18T00:34:24.992564+0000","last_peered":"2024-09-18T00:34:24.992564+0000","last_clean":"2024-09-18T00:34:24.992564+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:24.992564+0000","last_undegraded":"2024-09-18T00:34:24.992564+0000","last_fullsized":"2024-09-18T00:34:24.992564+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:19.940854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"144'620","reported_seq":9388,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475742+0000","last_change":"2024-09-18T00:34:11.899578+0000","last_active":"2024-09-18T00:34:25.475742+0000","last_peered":"2024-09-18T00:34:25.475742+0000","last_clean":"2024-09-18T00:34:25.475742+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:25.475742+0000","last_undegraded":"2024-09-18T00:34:25.475742+0000","last_fullsized":"2024-09-18T00:34:25.475742+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:25.964690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231895+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:34:25.231895+0000","last_peered":"2024-09-18T00:34:25.231895+0000","last_clean":"2024-09-18T00:34:25.231895+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:25.231895+0000","last_undegraded":"2024-09-18T00:34:25.231895+0000","last_fullsized":"2024-09-18T00:34:25.231895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"150'526","reported_seq":5711,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817581+0000","last_change":"2024-09-18T00:34:10.982307+0000","last_active":"2024-09-18T00:34:25.817581+0000","last_peered":"2024-09-18T00:34:25.817581+0000","last_clean":"2024-09-18T00:34:25.817581+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:25.817581+0000","last_undegraded":"2024-09-18T00:34:25.817581+0000","last_fullsized":"2024-09-18T00:34:25.817581+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:05.019472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":226,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816106+0000","last_change":"2024-09-18T00:34:10.900639+0000","last_active":"2024-09-18T00:34:25.816106+0000","last_peered":"2024-09-18T00:34:25.816106+0000","last_clean":"2024-09-18T00:34:25.816106+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:25.816106+0000","last_undegraded":"2024-09-18T00:34:25.816106+0000","last_fullsized":"2024-09-18T00:34:25.816106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:23.353390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":456,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232029+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:34:25.232029+0000","last_peered":"2024-09-18T00:34:25.232029+0000","last_clean":"2024-09-18T00:34:25.232029+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:25.232029+0000","last_undegraded":"2024-09-18T00:34:25.232029+0000","last_fullsized":"2024-09-18T00:34:25.232029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"144'556","reported_seq":8024,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817466+0000","last_change":"2024-09-18T00:33:58.915754+0000","last_active":"2024-09-18T00:34:25.817466+0000","last_peered":"2024-09-18T00:34:25.817466+0000","last_clean":"2024-09-18T00:34:25.817466+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:25.817466+0000","last_undegraded":"2024-09-18T00:34:25.817466+0000","last_fullsized":"2024-09-18T00:34:25.817466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:05:29.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"144'559","reported_seq":8539,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992477+0000","last_change":"2024-09-18T00:33:58.847033+0000","last_active":"2024-09-18T00:34:24.992477+0000","last_peered":"2024-09-18T00:34:24.992477+0000","last_clean":"2024-09-18T00:34:24.992477+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:24.992477+0000","last_undegraded":"2024-09-18T00:34:24.992477+0000","last_fullsized":"2024-09-18T00:34:24.992477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:45.459931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"144'431","reported_seq":6440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370966+0000","last_change":"2024-09-18T00:33:58.841509+0000","last_active":"2024-09-18T00:34:25.370966+0000","last_peered":"2024-09-18T00:34:25.370966+0000","last_clean":"2024-09-18T00:34:25.370966+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:25.370966+0000","last_undegraded":"2024-09-18T00:34:25.370966+0000","last_fullsized":"2024-09-18T00:34:25.370966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:31.149905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"143'703","reported_seq":5579,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816837+0000","last_change":"2024-09-18T00:33:58.914778+0000","last_active":"2024-09-18T00:34:25.816837+0000","last_peered":"2024-09-18T00:34:25.816837+0000","last_clean":"2024-09-18T00:34:25.816837+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:25.816837+0000","last_undegraded":"2024-09-18T00:34:25.816837+0000","last_fullsized":"2024-09-18T00:34:25.816837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:07.031351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"150'371","reported_seq":4927,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816137+0000","last_change":"2024-09-18T00:34:11.173631+0000","last_active":"2024-09-18T00:34:25.816137+0000","last_peered":"2024-09-18T00:34:25.816137+0000","last_clean":"2024-09-18T00:34:25.816137+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:25.816137+0000","last_undegraded":"2024-09-18T00:34:25.816137+0000","last_fullsized":"2024-09-18T00:34:25.816137+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:12.847767+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"150'650","reported_seq":7010,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232084+0000","last_change":"2024-09-18T00:34:11.058471+0000","last_active":"2024-09-18T00:34:25.232084+0000","last_peered":"2024-09-18T00:34:25.232084+0000","last_clean":"2024-09-18T00:34:25.232084+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:25.232084+0000","last_undegraded":"2024-09-18T00:34:25.232084+0000","last_fullsized":"2024-09-18T00:34:25.232084+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:39.182028+0000","scrub_duration":0,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"144'773","reported_seq":11334,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232147+0000","last_change":"2024-09-18T00:33:58.856451+0000","last_active":"2024-09-18T00:34:25.232147+0000","last_peered":"2024-09-18T00:34:25.232147+0000","last_clean":"2024-09-18T00:34:25.232147+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:25.232147+0000","last_undegraded":"2024-09-18T00:34:25.232147+0000","last_fullsized":"2024-09-18T00:34:25.232147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:14.838716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"143'638","reported_seq":6380,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232174+0000","last_change":"2024-09-18T00:33:58.856397+0000","last_active":"2024-09-18T00:34:25.232174+0000","last_peered":"2024-09-18T00:34:25.232174+0000","last_clean":"2024-09-18T00:34:25.232174+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:25.232174+0000","last_undegraded":"2024-09-18T00:34:25.232174+0000","last_fullsized":"2024-09-18T00:34:25.232174+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:14.859123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"143'600","reported_seq":5223,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991638+0000","last_change":"2024-09-18T00:33:58.843666+0000","last_active":"2024-09-18T00:34:24.991638+0000","last_peered":"2024-09-18T00:34:24.991638+0000","last_clean":"2024-09-18T00:34:24.991638+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:24.991638+0000","last_undegraded":"2024-09-18T00:34:24.991638+0000","last_fullsized":"2024-09-18T00:34:24.991638+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:25.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"143'1369","reported_seq":6537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231968+0000","last_change":"2024-09-18T00:33:58.855500+0000","last_active":"2024-09-18T00:34:25.231968+0000","last_peered":"2024-09-18T00:34:25.231968+0000","last_clean":"2024-09-18T00:34:25.231968+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:25.231968+0000","last_undegraded":"2024-09-18T00:34:25.231968+0000","last_fullsized":"2024-09-18T00:34:25.231968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:16.993051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"143'580","reported_seq":7338,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475751+0000","last_change":"2024-09-18T00:34:11.900518+0000","last_active":"2024-09-18T00:34:25.475751+0000","last_peered":"2024-09-18T00:34:25.475751+0000","last_clean":"2024-09-18T00:34:25.475751+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:25.475751+0000","last_undegraded":"2024-09-18T00:34:25.475751+0000","last_fullsized":"2024-09-18T00:34:25.475751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:57.839332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"143'736","reported_seq":4221,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231997+0000","last_change":"2024-09-18T00:33:58.854818+0000","last_active":"2024-09-18T00:34:25.231997+0000","last_peered":"2024-09-18T00:34:25.231997+0000","last_clean":"2024-09-18T00:34:25.231997+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:25.231997+0000","last_undegraded":"2024-09-18T00:34:25.231997+0000","last_fullsized":"2024-09-18T00:34:25.231997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:20.262640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20612,"ondisk_log_size":20612,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59528,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312312,"statfs":{"total":96636764160,"available":96575807488,"internally_reserved":0,"allocated":2011136,"data_stored":1532213,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127110,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30684,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341156,"statfs":{"total":96636764160,"available":96605343744,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28964,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342876,"statfs":{"total":96636764160,"available":96607105024,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:29.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:29.833 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-18T00:34:29.068736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20732,"ondisk_log_size":20732,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369444,"kb_used_data":15452,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605276,"statfs":{"total":773094113280,"available":772715802624,"internally_reserved":0,"allocated":15822848,"data_stored":8744927,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088127"},"pg_stats":[{"pgid":"3.1f","version":"151'540","reported_seq":6064,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475897+0000","last_change":"2024-09-18T00:34:11.968109+0000","last_active":"2024-09-18T00:34:25.475897+0000","last_peered":"2024-09-18T00:34:25.475897+0000","last_clean":"2024-09-18T00:34:25.475897+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:25.475897+0000","last_undegraded":"2024-09-18T00:34:25.475897+0000","last_fullsized":"2024-09-18T00:34:25.475897+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:45.083482+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"143'619","reported_seq":4297,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817153+0000","last_change":"2024-09-18T00:33:58.914896+0000","last_active":"2024-09-18T00:34:25.817153+0000","last_peered":"2024-09-18T00:34:25.817153+0000","last_clean":"2024-09-18T00:34:25.817153+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:25.817153+0000","last_undegraded":"2024-09-18T00:34:25.817153+0000","last_fullsized":"2024-09-18T00:34:25.817153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:11.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"150'622","reported_seq":6838,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816129+0000","last_change":"2024-09-18T00:34:10.990561+0000","last_active":"2024-09-18T00:34:25.816129+0000","last_peered":"2024-09-18T00:34:25.816129+0000","last_clean":"2024-09-18T00:34:25.816129+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:25.816129+0000","last_undegraded":"2024-09-18T00:34:25.816129+0000","last_fullsized":"2024-09-18T00:34:25.816129+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:45.279057+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"150'791","reported_seq":6596,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816177+0000","last_change":"2024-09-18T00:34:11.109534+0000","last_active":"2024-09-18T00:34:25.816177+0000","last_peered":"2024-09-18T00:34:25.816177+0000","last_clean":"2024-09-18T00:34:25.816177+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:25.816177+0000","last_undegraded":"2024-09-18T00:34:25.816177+0000","last_fullsized":"2024-09-18T00:34:25.816177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:41.803194+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"143'851","reported_seq":4070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475836+0000","last_change":"2024-09-18T00:34:11.899310+0000","last_active":"2024-09-18T00:34:25.475836+0000","last_peered":"2024-09-18T00:34:25.475836+0000","last_clean":"2024-09-18T00:34:25.475836+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:25.475836+0000","last_undegraded":"2024-09-18T00:34:25.475836+0000","last_fullsized":"2024-09-18T00:34:25.475836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:41.721082+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"145'429","reported_seq":10537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992627+0000","last_change":"2024-09-18T00:33:58.847282+0000","last_active":"2024-09-18T00:34:24.992627+0000","last_peered":"2024-09-18T00:34:24.992627+0000","last_clean":"2024-09-18T00:34:24.992627+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:24.992627+0000","last_undegraded":"2024-09-18T00:34:24.992627+0000","last_fullsized":"2024-09-18T00:34:24.992627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:47.743442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"143'733","reported_seq":2759,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991697+0000","last_change":"2024-09-18T00:33:58.843733+0000","last_active":"2024-09-18T00:34:24.991697+0000","last_peered":"2024-09-18T00:34:24.991697+0000","last_clean":"2024-09-18T00:34:24.991697+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:24.991697+0000","last_undegraded":"2024-09-18T00:34:24.991697+0000","last_fullsized":"2024-09-18T00:34:24.991697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:06.718931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"143'451","reported_seq":6055,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817376+0000","last_change":"2024-09-18T00:33:58.915285+0000","last_active":"2024-09-18T00:34:25.817376+0000","last_peered":"2024-09-18T00:34:25.817376+0000","last_clean":"2024-09-18T00:34:25.817376+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:25.817376+0000","last_undegraded":"2024-09-18T00:34:25.817376+0000","last_fullsized":"2024-09-18T00:34:25.817376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:01.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'1057","reported_seq":5231,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475939+0000","last_change":"2024-09-18T00:34:11.943349+0000","last_active":"2024-09-18T00:34:25.475939+0000","last_peered":"2024-09-18T00:34:25.475939+0000","last_clean":"2024-09-18T00:34:25.475939+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:25.475939+0000","last_undegraded":"2024-09-18T00:34:25.475939+0000","last_fullsized":"2024-09-18T00:34:25.475939+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:21:17.217607+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"150'681","reported_seq":3578,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816179+0000","last_change":"2024-09-18T00:34:11.024249+0000","last_active":"2024-09-18T00:34:25.816179+0000","last_peered":"2024-09-18T00:34:25.816179+0000","last_clean":"2024-09-18T00:34:25.816179+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:25.816179+0000","last_undegraded":"2024-09-18T00:34:25.816179+0000","last_fullsized":"2024-09-18T00:34:25.816179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:31.836839+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"145'618","reported_seq":5715,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232119+0000","last_change":"2024-09-18T00:33:58.855576+0000","last_active":"2024-09-18T00:34:25.232119+0000","last_peered":"2024-09-18T00:34:25.232119+0000","last_clean":"2024-09-18T00:34:25.232119+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:25.232119+0000","last_undegraded":"2024-09-18T00:34:25.232119+0000","last_fullsized":"2024-09-18T00:34:25.232119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:47.459464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"143'471","reported_seq":6472,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992548+0000","last_change":"2024-09-18T00:33:58.846364+0000","last_active":"2024-09-18T00:34:24.992548+0000","last_peered":"2024-09-18T00:34:24.992548+0000","last_clean":"2024-09-18T00:34:24.992548+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:24.992548+0000","last_undegraded":"2024-09-18T00:34:24.992548+0000","last_fullsized":"2024-09-18T00:34:24.992548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:19.394023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370994+0000","last_change":"2024-09-18T00:33:22.779457+0000","last_active":"2024-09-18T00:34:25.370994+0000","last_peered":"2024-09-18T00:34:25.370994+0000","last_clean":"2024-09-18T00:34:25.370994+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:25.370994+0000","last_undegraded":"2024-09-18T00:34:25.370994+0000","last_fullsized":"2024-09-18T00:34:25.370994+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:32.956130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'367","reported_seq":2490,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475890+0000","last_change":"2024-09-18T00:33:58.875581+0000","last_active":"2024-09-18T00:34:25.475890+0000","last_peered":"2024-09-18T00:34:25.475890+0000","last_clean":"2024-09-18T00:34:25.475890+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:25.475890+0000","last_undegraded":"2024-09-18T00:34:25.475890+0000","last_fullsized":"2024-09-18T00:34:25.475890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:26.615195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991955+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:34:24.991955+0000","last_peered":"2024-09-18T00:34:24.991955+0000","last_clean":"2024-09-18T00:34:24.991955+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:24.991955+0000","last_undegraded":"2024-09-18T00:34:24.991955+0000","last_fullsized":"2024-09-18T00:34:24.991955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"144'541","reported_seq":3815,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817270+0000","last_change":"2024-09-18T00:33:58.915231+0000","last_active":"2024-09-18T00:34:25.817270+0000","last_peered":"2024-09-18T00:34:25.817270+0000","last_clean":"2024-09-18T00:34:25.817270+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:25.817270+0000","last_undegraded":"2024-09-18T00:34:25.817270+0000","last_fullsized":"2024-09-18T00:34:25.817270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:15:00.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232230+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:34:25.232230+0000","last_peered":"2024-09-18T00:34:25.232230+0000","last_clean":"2024-09-18T00:34:25.232230+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:25.232230+0000","last_undegraded":"2024-09-18T00:34:25.232230+0000","last_fullsized":"2024-09-18T00:34:25.232230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"145'604","reported_seq":4126,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991748+0000","last_change":"2024-09-18T00:33:58.844330+0000","last_active":"2024-09-18T00:34:24.991748+0000","last_peered":"2024-09-18T00:34:24.991748+0000","last_clean":"2024-09-18T00:34:24.991748+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:24.991748+0000","last_undegraded":"2024-09-18T00:34:24.991748+0000","last_fullsized":"2024-09-18T00:34:24.991748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:38:44.367873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991859+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:34:24.991859+0000","last_peered":"2024-09-18T00:34:24.991859+0000","last_clean":"2024-09-18T00:34:24.991859+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:24.991859+0000","last_undegraded":"2024-09-18T00:34:24.991859+0000","last_fullsized":"2024-09-18T00:34:24.991859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'1052","reported_seq":5279,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816126+0000","last_change":"2024-09-18T00:34:11.145910+0000","last_active":"2024-09-18T00:34:25.816126+0000","last_peered":"2024-09-18T00:34:25.816126+0000","last_clean":"2024-09-18T00:34:25.816126+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:25.816126+0000","last_undegraded":"2024-09-18T00:34:25.816126+0000","last_fullsized":"2024-09-18T00:34:25.816126+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:23.247998+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"145'644","reported_seq":3564,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992505+0000","last_change":"2024-09-18T00:33:58.848118+0000","last_active":"2024-09-18T00:34:24.992505+0000","last_peered":"2024-09-18T00:34:24.992505+0000","last_clean":"2024-09-18T00:34:24.992505+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:24.992505+0000","last_undegraded":"2024-09-18T00:34:24.992505+0000","last_fullsized":"2024-09-18T00:34:24.992505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:48.142039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":227,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816105+0000","last_change":"2024-09-18T00:34:10.900377+0000","last_active":"2024-09-18T00:34:25.816105+0000","last_peered":"2024-09-18T00:34:25.816105+0000","last_clean":"2024-09-18T00:34:25.816105+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:25.816105+0000","last_undegraded":"2024-09-18T00:34:25.816105+0000","last_fullsized":"2024-09-18T00:34:25.816105+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:16.361358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"143'429","reported_seq":2440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991742+0000","last_change":"2024-09-18T00:33:58.844266+0000","last_active":"2024-09-18T00:34:24.991742+0000","last_peered":"2024-09-18T00:34:24.991742+0000","last_clean":"2024-09-18T00:34:24.991742+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:24.991742+0000","last_undegraded":"2024-09-18T00:34:24.991742+0000","last_fullsized":"2024-09-18T00:34:24.991742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:00.303484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992564+0000","last_change":"2024-09-18T00:34:16.067443+0000","last_active":"2024-09-18T00:34:24.992564+0000","last_peered":"2024-09-18T00:34:24.992564+0000","last_clean":"2024-09-18T00:34:24.992564+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:24.992564+0000","last_undegraded":"2024-09-18T00:34:24.992564+0000","last_fullsized":"2024-09-18T00:34:24.992564+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:19.940854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"144'620","reported_seq":9388,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475742+0000","last_change":"2024-09-18T00:34:11.899578+0000","last_active":"2024-09-18T00:34:25.475742+0000","last_peered":"2024-09-18T00:34:25.475742+0000","last_clean":"2024-09-18T00:34:25.475742+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:25.475742+0000","last_undegraded":"2024-09-18T00:34:25.475742+0000","last_fullsized":"2024-09-18T00:34:25.475742+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:25.964690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231895+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:34:25.231895+0000","last_peered":"2024-09-18T00:34:25.231895+0000","last_clean":"2024-09-18T00:34:25.231895+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:25.231895+0000","last_undegraded":"2024-09-18T00:34:25.231895+0000","last_fullsized":"2024-09-18T00:34:25.231895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"150'526","reported_seq":5711,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817581+0000","last_change":"2024-09-18T00:34:10.982307+0000","last_active":"2024-09-18T00:34:25.817581+0000","last_peered":"2024-09-18T00:34:25.817581+0000","last_clean":"2024-09-18T00:34:25.817581+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:25.817581+0000","last_undegraded":"2024-09-18T00:34:25.817581+0000","last_fullsized":"2024-09-18T00:34:25.817581+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:05.019472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":226,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816106+0000","last_change":"2024-09-18T00:34:10.900639+0000","last_active":"2024-09-18T00:34:25.816106+0000","last_peered":"2024-09-18T00:34:25.816106+0000","last_clean":"2024-09-18T00:34:25.816106+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:25.816106+0000","last_undegraded":"2024-09-18T00:34:25.816106+0000","last_fullsized":"2024-09-18T00:34:25.816106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:23.353390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":456,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232029+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:34:25.232029+0000","last_peered":"2024-09-18T00:34:25.232029+0000","last_clean":"2024-09-18T00:34:25.232029+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:25.232029+0000","last_undegraded":"2024-09-18T00:34:25.232029+0000","last_fullsized":"2024-09-18T00:34:25.232029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"144'556","reported_seq":8024,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817466+0000","last_change":"2024-09-18T00:33:58.915754+0000","last_active":"2024-09-18T00:34:25.817466+0000","last_peered":"2024-09-18T00:34:25.817466+0000","last_clean":"2024-09-18T00:34:25.817466+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:25.817466+0000","last_undegraded":"2024-09-18T00:34:25.817466+0000","last_fullsized":"2024-09-18T00:34:25.817466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:05:29.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"144'559","reported_seq":8539,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992477+0000","last_change":"2024-09-18T00:33:58.847033+0000","last_active":"2024-09-18T00:34:24.992477+0000","last_peered":"2024-09-18T00:34:24.992477+0000","last_clean":"2024-09-18T00:34:24.992477+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:24.992477+0000","last_undegraded":"2024-09-18T00:34:24.992477+0000","last_fullsized":"2024-09-18T00:34:24.992477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:45.459931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"144'431","reported_seq":6440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370966+0000","last_change":"2024-09-18T00:33:58.841509+0000","last_active":"2024-09-18T00:34:25.370966+0000","last_peered":"2024-09-18T00:34:25.370966+0000","last_clean":"2024-09-18T00:34:25.370966+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:25.370966+0000","last_undegraded":"2024-09-18T00:34:25.370966+0000","last_fullsized":"2024-09-18T00:34:25.370966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:31.149905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"143'703","reported_seq":5579,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816837+0000","last_change":"2024-09-18T00:33:58.914778+0000","last_active":"2024-09-18T00:34:25.816837+0000","last_peered":"2024-09-18T00:34:25.816837+0000","last_clean":"2024-09-18T00:34:25.816837+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:25.816837+0000","last_undegraded":"2024-09-18T00:34:25.816837+0000","last_fullsized":"2024-09-18T00:34:25.816837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:07.031351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"150'371","reported_seq":4927,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816137+0000","last_change":"2024-09-18T00:34:11.173631+0000","last_active":"2024-09-18T00:34:25.816137+0000","last_peered":"2024-09-18T00:34:25.816137+0000","last_clean":"2024-09-18T00:34:25.816137+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:25.816137+0000","last_undegraded":"2024-09-18T00:34:25.816137+0000","last_fullsized":"2024-09-18T00:34:25.816137+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:12.847767+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"150'650","reported_seq":7010,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232084+0000","last_change":"2024-09-18T00:34:11.058471+0000","last_active":"2024-09-18T00:34:25.232084+0000","last_peered":"2024-09-18T00:34:25.232084+0000","last_clean":"2024-09-18T00:34:25.232084+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:25.232084+0000","last_undegraded":"2024-09-18T00:34:25.232084+0000","last_fullsized":"2024-09-18T00:34:25.232084+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:39.182028+0000","scrub_duration":0,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"144'773","reported_seq":11334,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232147+0000","last_change":"2024-09-18T00:33:58.856451+0000","last_active":"2024-09-18T00:34:25.232147+0000","last_peered":"2024-09-18T00:34:25.232147+0000","last_clean":"2024-09-18T00:34:25.232147+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:25.232147+0000","last_undegraded":"2024-09-18T00:34:25.232147+0000","last_fullsized":"2024-09-18T00:34:25.232147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:14.838716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"143'638","reported_seq":6380,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232174+0000","last_change":"2024-09-18T00:33:58.856397+0000","last_active":"2024-09-18T00:34:25.232174+0000","last_peered":"2024-09-18T00:34:25.232174+0000","last_clean":"2024-09-18T00:34:25.232174+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:25.232174+0000","last_undegraded":"2024-09-18T00:34:25.232174+0000","last_fullsized":"2024-09-18T00:34:25.232174+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:14.859123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"143'600","reported_seq":5223,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991638+0000","last_change":"2024-09-18T00:33:58.843666+0000","last_active":"2024-09-18T00:34:24.991638+0000","last_peered":"2024-09-18T00:34:24.991638+0000","last_clean":"2024-09-18T00:34:24.991638+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:24.991638+0000","last_undegraded":"2024-09-18T00:34:24.991638+0000","last_fullsized":"2024-09-18T00:34:24.991638+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:25.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"143'1369","reported_seq":6537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231968+0000","last_change":"2024-09-18T00:33:58.855500+0000","last_active":"2024-09-18T00:34:25.231968+0000","last_peered":"2024-09-18T00:34:25.231968+0000","last_clean":"2024-09-18T00:34:25.231968+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:25.231968+0000","last_undegraded":"2024-09-18T00:34:25.231968+0000","last_fullsized":"2024-09-18T00:34:25.231968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:16.993051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"143'580","reported_seq":7338,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475751+0000","last_change":"2024-09-18T00:34:11.900518+0000","last_active":"2024-09-18T00:34:25.475751+0000","last_peered":"2024-09-18T00:34:25.475751+0000","last_clean":"2024-09-18T00:34:25.475751+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:25.475751+0000","last_undegraded":"2024-09-18T00:34:25.475751+0000","last_fullsized":"2024-09-18T00:34:25.475751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:57.839332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"143'736","reported_seq":4221,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231997+0000","last_change":"2024-09-18T00:33:58.854818+0000","last_active":"2024-09-18T00:34:25.231997+0000","last_peered":"2024-09-18T00:34:25.231997+0000","last_clean":"2024-09-18T00:34:25.231997+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:25.231997+0000","last_undegraded":"2024-09-18T00:34:25.231997+0000","last_fullsized":"2024-09-18T00:34:25.231997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:20.262640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20612,"ondisk_log_size":20612,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59528,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312312,"statfs":{"total":96636764160,"available":96575807488,"internally_reserved":0,"allocated":2011136,"data_stored":1532213,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127110,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30684,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341156,"statfs":{"total":96636764160,"available":96605343744,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28964,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342876,"statfs":{"total":96636764160,"available":96607105024,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:29.835 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T00:34:29.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-18T00:34:30.132 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T00:34:30.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T00:34:30.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:30.442 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-18T00:34:29.068736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20732,"ondisk_log_size":20732,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369444,"kb_used_data":15452,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605276,"statfs":{"total":773094113280,"available":772715802624,"internally_reserved":0,"allocated":15822848,"data_stored":8744927,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088127"},"pg_stats":[{"pgid":"3.1f","version":"151'540","reported_seq":6064,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475897+0000","last_change":"2024-09-18T00:34:11.968109+0000","last_active":"2024-09-18T00:34:25.475897+0000","last_peered":"2024-09-18T00:34:25.475897+0000","last_clean":"2024-09-18T00:34:25.475897+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:25.475897+0000","last_undegraded":"2024-09-18T00:34:25.475897+0000","last_fullsized":"2024-09-18T00:34:25.475897+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:45.083482+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"143'619","reported_seq":4297,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817153+0000","last_change":"2024-09-18T00:33:58.914896+0000","last_active":"2024-09-18T00:34:25.817153+0000","last_peered":"2024-09-18T00:34:25.817153+0000","last_clean":"2024-09-18T00:34:25.817153+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:25.817153+0000","last_undegraded":"2024-09-18T00:34:25.817153+0000","last_fullsized":"2024-09-18T00:34:25.817153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:11.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"150'622","reported_seq":6838,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816129+0000","last_change":"2024-09-18T00:34:10.990561+0000","last_active":"2024-09-18T00:34:25.816129+0000","last_peered":"2024-09-18T00:34:25.816129+0000","last_clean":"2024-09-18T00:34:25.816129+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:25.816129+0000","last_undegraded":"2024-09-18T00:34:25.816129+0000","last_fullsized":"2024-09-18T00:34:25.816129+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:45.279057+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"150'791","reported_seq":6596,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816177+0000","last_change":"2024-09-18T00:34:11.109534+0000","last_active":"2024-09-18T00:34:25.816177+0000","last_peered":"2024-09-18T00:34:25.816177+0000","last_clean":"2024-09-18T00:34:25.816177+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:25.816177+0000","last_undegraded":"2024-09-18T00:34:25.816177+0000","last_fullsized":"2024-09-18T00:34:25.816177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:41.803194+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"143'851","reported_seq":4070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475836+0000","last_change":"2024-09-18T00:34:11.899310+0000","last_active":"2024-09-18T00:34:25.475836+0000","last_peered":"2024-09-18T00:34:25.475836+0000","last_clean":"2024-09-18T00:34:25.475836+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:25.475836+0000","last_undegraded":"2024-09-18T00:34:25.475836+0000","last_fullsized":"2024-09-18T00:34:25.475836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:41.721082+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"145'429","reported_seq":10537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992627+0000","last_change":"2024-09-18T00:33:58.847282+0000","last_active":"2024-09-18T00:34:24.992627+0000","last_peered":"2024-09-18T00:34:24.992627+0000","last_clean":"2024-09-18T00:34:24.992627+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:24.992627+0000","last_undegraded":"2024-09-18T00:34:24.992627+0000","last_fullsized":"2024-09-18T00:34:24.992627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:47.743442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"143'733","reported_seq":2759,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991697+0000","last_change":"2024-09-18T00:33:58.843733+0000","last_active":"2024-09-18T00:34:24.991697+0000","last_peered":"2024-09-18T00:34:24.991697+0000","last_clean":"2024-09-18T00:34:24.991697+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:24.991697+0000","last_undegraded":"2024-09-18T00:34:24.991697+0000","last_fullsized":"2024-09-18T00:34:24.991697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:06.718931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"143'451","reported_seq":6055,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817376+0000","last_change":"2024-09-18T00:33:58.915285+0000","last_active":"2024-09-18T00:34:25.817376+0000","last_peered":"2024-09-18T00:34:25.817376+0000","last_clean":"2024-09-18T00:34:25.817376+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:25.817376+0000","last_undegraded":"2024-09-18T00:34:25.817376+0000","last_fullsized":"2024-09-18T00:34:25.817376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:01.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'1057","reported_seq":5231,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475939+0000","last_change":"2024-09-18T00:34:11.943349+0000","last_active":"2024-09-18T00:34:25.475939+0000","last_peered":"2024-09-18T00:34:25.475939+0000","last_clean":"2024-09-18T00:34:25.475939+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:25.475939+0000","last_undegraded":"2024-09-18T00:34:25.475939+0000","last_fullsized":"2024-09-18T00:34:25.475939+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:21:17.217607+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"150'681","reported_seq":3578,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816179+0000","last_change":"2024-09-18T00:34:11.024249+0000","last_active":"2024-09-18T00:34:25.816179+0000","last_peered":"2024-09-18T00:34:25.816179+0000","last_clean":"2024-09-18T00:34:25.816179+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:25.816179+0000","last_undegraded":"2024-09-18T00:34:25.816179+0000","last_fullsized":"2024-09-18T00:34:25.816179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:31.836839+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"145'618","reported_seq":5715,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232119+0000","last_change":"2024-09-18T00:33:58.855576+0000","last_active":"2024-09-18T00:34:25.232119+0000","last_peered":"2024-09-18T00:34:25.232119+0000","last_clean":"2024-09-18T00:34:25.232119+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:25.232119+0000","last_undegraded":"2024-09-18T00:34:25.232119+0000","last_fullsized":"2024-09-18T00:34:25.232119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:47.459464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"143'471","reported_seq":6472,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992548+0000","last_change":"2024-09-18T00:33:58.846364+0000","last_active":"2024-09-18T00:34:24.992548+0000","last_peered":"2024-09-18T00:34:24.992548+0000","last_clean":"2024-09-18T00:34:24.992548+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:24.992548+0000","last_undegraded":"2024-09-18T00:34:24.992548+0000","last_fullsized":"2024-09-18T00:34:24.992548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:19.394023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370994+0000","last_change":"2024-09-18T00:33:22.779457+0000","last_active":"2024-09-18T00:34:25.370994+0000","last_peered":"2024-09-18T00:34:25.370994+0000","last_clean":"2024-09-18T00:34:25.370994+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:25.370994+0000","last_undegraded":"2024-09-18T00:34:25.370994+0000","last_fullsized":"2024-09-18T00:34:25.370994+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:32.956130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'367","reported_seq":2490,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475890+0000","last_change":"2024-09-18T00:33:58.875581+0000","last_active":"2024-09-18T00:34:25.475890+0000","last_peered":"2024-09-18T00:34:25.475890+0000","last_clean":"2024-09-18T00:34:25.475890+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:25.475890+0000","last_undegraded":"2024-09-18T00:34:25.475890+0000","last_fullsized":"2024-09-18T00:34:25.475890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:26.615195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991955+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:34:24.991955+0000","last_peered":"2024-09-18T00:34:24.991955+0000","last_clean":"2024-09-18T00:34:24.991955+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:24.991955+0000","last_undegraded":"2024-09-18T00:34:24.991955+0000","last_fullsized":"2024-09-18T00:34:24.991955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"144'541","reported_seq":3815,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817270+0000","last_change":"2024-09-18T00:33:58.915231+0000","last_active":"2024-09-18T00:34:25.817270+0000","last_peered":"2024-09-18T00:34:25.817270+0000","last_clean":"2024-09-18T00:34:25.817270+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:25.817270+0000","last_undegraded":"2024-09-18T00:34:25.817270+0000","last_fullsized":"2024-09-18T00:34:25.817270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:15:00.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232230+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:34:25.232230+0000","last_peered":"2024-09-18T00:34:25.232230+0000","last_clean":"2024-09-18T00:34:25.232230+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:25.232230+0000","last_undegraded":"2024-09-18T00:34:25.232230+0000","last_fullsized":"2024-09-18T00:34:25.232230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"145'604","reported_seq":4126,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991748+0000","last_change":"2024-09-18T00:33:58.844330+0000","last_active":"2024-09-18T00:34:24.991748+0000","last_peered":"2024-09-18T00:34:24.991748+0000","last_clean":"2024-09-18T00:34:24.991748+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:24.991748+0000","last_undegraded":"2024-09-18T00:34:24.991748+0000","last_fullsized":"2024-09-18T00:34:24.991748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:38:44.367873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991859+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:34:24.991859+0000","last_peered":"2024-09-18T00:34:24.991859+0000","last_clean":"2024-09-18T00:34:24.991859+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:24.991859+0000","last_undegraded":"2024-09-18T00:34:24.991859+0000","last_fullsized":"2024-09-18T00:34:24.991859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'1052","reported_seq":5279,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816126+0000","last_change":"2024-09-18T00:34:11.145910+0000","last_active":"2024-09-18T00:34:25.816126+0000","last_peered":"2024-09-18T00:34:25.816126+0000","last_clean":"2024-09-18T00:34:25.816126+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:25.816126+0000","last_undegraded":"2024-09-18T00:34:25.816126+0000","last_fullsized":"2024-09-18T00:34:25.816126+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:23.247998+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"145'644","reported_seq":3564,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992505+0000","last_change":"2024-09-18T00:33:58.848118+0000","last_active":"2024-09-18T00:34:24.992505+0000","last_peered":"2024-09-18T00:34:24.992505+0000","last_clean":"2024-09-18T00:34:24.992505+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:24.992505+0000","last_undegraded":"2024-09-18T00:34:24.992505+0000","last_fullsized":"2024-09-18T00:34:24.992505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:48.142039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":227,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816105+0000","last_change":"2024-09-18T00:34:10.900377+0000","last_active":"2024-09-18T00:34:25.816105+0000","last_peered":"2024-09-18T00:34:25.816105+0000","last_clean":"2024-09-18T00:34:25.816105+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:25.816105+0000","last_undegraded":"2024-09-18T00:34:25.816105+0000","last_fullsized":"2024-09-18T00:34:25.816105+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:16.361358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"143'429","reported_seq":2440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991742+0000","last_change":"2024-09-18T00:33:58.844266+0000","last_active":"2024-09-18T00:34:24.991742+0000","last_peered":"2024-09-18T00:34:24.991742+0000","last_clean":"2024-09-18T00:34:24.991742+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:24.991742+0000","last_undegraded":"2024-09-18T00:34:24.991742+0000","last_fullsized":"2024-09-18T00:34:24.991742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:00.303484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992564+0000","last_change":"2024-09-18T00:34:16.067443+0000","last_active":"2024-09-18T00:34:24.992564+0000","last_peered":"2024-09-18T00:34:24.992564+0000","last_clean":"2024-09-18T00:34:24.992564+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:24.992564+0000","last_undegraded":"2024-09-18T00:34:24.992564+0000","last_fullsized":"2024-09-18T00:34:24.992564+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:19.940854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"144'620","reported_seq":9388,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475742+0000","last_change":"2024-09-18T00:34:11.899578+0000","last_active":"2024-09-18T00:34:25.475742+0000","last_peered":"2024-09-18T00:34:25.475742+0000","last_clean":"2024-09-18T00:34:25.475742+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:25.475742+0000","last_undegraded":"2024-09-18T00:34:25.475742+0000","last_fullsized":"2024-09-18T00:34:25.475742+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:25.964690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231895+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:34:25.231895+0000","last_peered":"2024-09-18T00:34:25.231895+0000","last_clean":"2024-09-18T00:34:25.231895+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:25.231895+0000","last_undegraded":"2024-09-18T00:34:25.231895+0000","last_fullsized":"2024-09-18T00:34:25.231895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"150'526","reported_seq":5711,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817581+0000","last_change":"2024-09-18T00:34:10.982307+0000","last_active":"2024-09-18T00:34:25.817581+0000","last_peered":"2024-09-18T00:34:25.817581+0000","last_clean":"2024-09-18T00:34:25.817581+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:25.817581+0000","last_undegraded":"2024-09-18T00:34:25.817581+0000","last_fullsized":"2024-09-18T00:34:25.817581+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:05.019472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":226,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816106+0000","last_change":"2024-09-18T00:34:10.900639+0000","last_active":"2024-09-18T00:34:25.816106+0000","last_peered":"2024-09-18T00:34:25.816106+0000","last_clean":"2024-09-18T00:34:25.816106+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:25.816106+0000","last_undegraded":"2024-09-18T00:34:25.816106+0000","last_fullsized":"2024-09-18T00:34:25.816106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:23.353390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":456,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232029+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:34:25.232029+0000","last_peered":"2024-09-18T00:34:25.232029+0000","last_clean":"2024-09-18T00:34:25.232029+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:25.232029+0000","last_undegraded":"2024-09-18T00:34:25.232029+0000","last_fullsized":"2024-09-18T00:34:25.232029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"144'556","reported_seq":8024,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817466+0000","last_change":"2024-09-18T00:33:58.915754+0000","last_active":"2024-09-18T00:34:25.817466+0000","last_peered":"2024-09-18T00:34:25.817466+0000","last_clean":"2024-09-18T00:34:25.817466+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:25.817466+0000","last_undegraded":"2024-09-18T00:34:25.817466+0000","last_fullsized":"2024-09-18T00:34:25.817466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:05:29.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"144'559","reported_seq":8539,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992477+0000","last_change":"2024-09-18T00:33:58.847033+0000","last_active":"2024-09-18T00:34:24.992477+0000","last_peered":"2024-09-18T00:34:24.992477+0000","last_clean":"2024-09-18T00:34:24.992477+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:24.992477+0000","last_undegraded":"2024-09-18T00:34:24.992477+0000","last_fullsized":"2024-09-18T00:34:24.992477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:45.459931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"144'431","reported_seq":6440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370966+0000","last_change":"2024-09-18T00:33:58.841509+0000","last_active":"2024-09-18T00:34:25.370966+0000","last_peered":"2024-09-18T00:34:25.370966+0000","last_clean":"2024-09-18T00:34:25.370966+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:25.370966+0000","last_undegraded":"2024-09-18T00:34:25.370966+0000","last_fullsized":"2024-09-18T00:34:25.370966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:31.149905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"143'703","reported_seq":5579,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816837+0000","last_change":"2024-09-18T00:33:58.914778+0000","last_active":"2024-09-18T00:34:25.816837+0000","last_peered":"2024-09-18T00:34:25.816837+0000","last_clean":"2024-09-18T00:34:25.816837+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:25.816837+0000","last_undegraded":"2024-09-18T00:34:25.816837+0000","last_fullsized":"2024-09-18T00:34:25.816837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:07.031351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"150'371","reported_seq":4927,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816137+0000","last_change":"2024-09-18T00:34:11.173631+0000","last_active":"2024-09-18T00:34:25.816137+0000","last_peered":"2024-09-18T00:34:25.816137+0000","last_clean":"2024-09-18T00:34:25.816137+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:25.816137+0000","last_undegraded":"2024-09-18T00:34:25.816137+0000","last_fullsized":"2024-09-18T00:34:25.816137+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:12.847767+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"150'650","reported_seq":7010,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232084+0000","last_change":"2024-09-18T00:34:11.058471+0000","last_active":"2024-09-18T00:34:25.232084+0000","last_peered":"2024-09-18T00:34:25.232084+0000","last_clean":"2024-09-18T00:34:25.232084+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:25.232084+0000","last_undegraded":"2024-09-18T00:34:25.232084+0000","last_fullsized":"2024-09-18T00:34:25.232084+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:39.182028+0000","scrub_duration":0,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"144'773","reported_seq":11334,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232147+0000","last_change":"2024-09-18T00:33:58.856451+0000","last_active":"2024-09-18T00:34:25.232147+0000","last_peered":"2024-09-18T00:34:25.232147+0000","last_clean":"2024-09-18T00:34:25.232147+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:25.232147+0000","last_undegraded":"2024-09-18T00:34:25.232147+0000","last_fullsized":"2024-09-18T00:34:25.232147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:14.838716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"143'638","reported_seq":6380,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232174+0000","last_change":"2024-09-18T00:33:58.856397+0000","last_active":"2024-09-18T00:34:25.232174+0000","last_peered":"2024-09-18T00:34:25.232174+0000","last_clean":"2024-09-18T00:34:25.232174+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:25.232174+0000","last_undegraded":"2024-09-18T00:34:25.232174+0000","last_fullsized":"2024-09-18T00:34:25.232174+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:14.859123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"143'600","reported_seq":5223,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991638+0000","last_change":"2024-09-18T00:33:58.843666+0000","last_active":"2024-09-18T00:34:24.991638+0000","last_peered":"2024-09-18T00:34:24.991638+0000","last_clean":"2024-09-18T00:34:24.991638+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:24.991638+0000","last_undegraded":"2024-09-18T00:34:24.991638+0000","last_fullsized":"2024-09-18T00:34:24.991638+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:25.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"143'1369","reported_seq":6537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231968+0000","last_change":"2024-09-18T00:33:58.855500+0000","last_active":"2024-09-18T00:34:25.231968+0000","last_peered":"2024-09-18T00:34:25.231968+0000","last_clean":"2024-09-18T00:34:25.231968+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:25.231968+0000","last_undegraded":"2024-09-18T00:34:25.231968+0000","last_fullsized":"2024-09-18T00:34:25.231968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:16.993051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"143'580","reported_seq":7338,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475751+0000","last_change":"2024-09-18T00:34:11.900518+0000","last_active":"2024-09-18T00:34:25.475751+0000","last_peered":"2024-09-18T00:34:25.475751+0000","last_clean":"2024-09-18T00:34:25.475751+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:25.475751+0000","last_undegraded":"2024-09-18T00:34:25.475751+0000","last_fullsized":"2024-09-18T00:34:25.475751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:57.839332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"143'736","reported_seq":4221,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231997+0000","last_change":"2024-09-18T00:33:58.854818+0000","last_active":"2024-09-18T00:34:25.231997+0000","last_peered":"2024-09-18T00:34:25.231997+0000","last_clean":"2024-09-18T00:34:25.231997+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:25.231997+0000","last_undegraded":"2024-09-18T00:34:25.231997+0000","last_fullsized":"2024-09-18T00:34:25.231997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:20.262640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20612,"ondisk_log_size":20612,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59528,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312312,"statfs":{"total":96636764160,"available":96575807488,"internally_reserved":0,"allocated":2011136,"data_stored":1532213,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127110,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30684,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341156,"statfs":{"total":96636764160,"available":96605343744,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28964,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342876,"statfs":{"total":96636764160,"available":96607105024,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:30.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:30.733 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-18T00:34:29.068736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20732,"ondisk_log_size":20732,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369444,"kb_used_data":15452,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605276,"statfs":{"total":773094113280,"available":772715802624,"internally_reserved":0,"allocated":15822848,"data_stored":8744927,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088127"},"pg_stats":[{"pgid":"3.1f","version":"151'540","reported_seq":6064,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475897+0000","last_change":"2024-09-18T00:34:11.968109+0000","last_active":"2024-09-18T00:34:25.475897+0000","last_peered":"2024-09-18T00:34:25.475897+0000","last_clean":"2024-09-18T00:34:25.475897+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:25.475897+0000","last_undegraded":"2024-09-18T00:34:25.475897+0000","last_fullsized":"2024-09-18T00:34:25.475897+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:45.083482+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"143'619","reported_seq":4297,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817153+0000","last_change":"2024-09-18T00:33:58.914896+0000","last_active":"2024-09-18T00:34:25.817153+0000","last_peered":"2024-09-18T00:34:25.817153+0000","last_clean":"2024-09-18T00:34:25.817153+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:25.817153+0000","last_undegraded":"2024-09-18T00:34:25.817153+0000","last_fullsized":"2024-09-18T00:34:25.817153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:11.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"150'622","reported_seq":6838,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816129+0000","last_change":"2024-09-18T00:34:10.990561+0000","last_active":"2024-09-18T00:34:25.816129+0000","last_peered":"2024-09-18T00:34:25.816129+0000","last_clean":"2024-09-18T00:34:25.816129+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:25.816129+0000","last_undegraded":"2024-09-18T00:34:25.816129+0000","last_fullsized":"2024-09-18T00:34:25.816129+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:45.279057+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"150'791","reported_seq":6596,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816177+0000","last_change":"2024-09-18T00:34:11.109534+0000","last_active":"2024-09-18T00:34:25.816177+0000","last_peered":"2024-09-18T00:34:25.816177+0000","last_clean":"2024-09-18T00:34:25.816177+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:25.816177+0000","last_undegraded":"2024-09-18T00:34:25.816177+0000","last_fullsized":"2024-09-18T00:34:25.816177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:41.803194+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"143'851","reported_seq":4070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475836+0000","last_change":"2024-09-18T00:34:11.899310+0000","last_active":"2024-09-18T00:34:25.475836+0000","last_peered":"2024-09-18T00:34:25.475836+0000","last_clean":"2024-09-18T00:34:25.475836+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:25.475836+0000","last_undegraded":"2024-09-18T00:34:25.475836+0000","last_fullsized":"2024-09-18T00:34:25.475836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:41.721082+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"145'429","reported_seq":10537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992627+0000","last_change":"2024-09-18T00:33:58.847282+0000","last_active":"2024-09-18T00:34:24.992627+0000","last_peered":"2024-09-18T00:34:24.992627+0000","last_clean":"2024-09-18T00:34:24.992627+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:24.992627+0000","last_undegraded":"2024-09-18T00:34:24.992627+0000","last_fullsized":"2024-09-18T00:34:24.992627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:47.743442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"143'733","reported_seq":2759,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991697+0000","last_change":"2024-09-18T00:33:58.843733+0000","last_active":"2024-09-18T00:34:24.991697+0000","last_peered":"2024-09-18T00:34:24.991697+0000","last_clean":"2024-09-18T00:34:24.991697+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:24.991697+0000","last_undegraded":"2024-09-18T00:34:24.991697+0000","last_fullsized":"2024-09-18T00:34:24.991697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:06.718931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"143'451","reported_seq":6055,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817376+0000","last_change":"2024-09-18T00:33:58.915285+0000","last_active":"2024-09-18T00:34:25.817376+0000","last_peered":"2024-09-18T00:34:25.817376+0000","last_clean":"2024-09-18T00:34:25.817376+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:25.817376+0000","last_undegraded":"2024-09-18T00:34:25.817376+0000","last_fullsized":"2024-09-18T00:34:25.817376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:01.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'1057","reported_seq":5231,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475939+0000","last_change":"2024-09-18T00:34:11.943349+0000","last_active":"2024-09-18T00:34:25.475939+0000","last_peered":"2024-09-18T00:34:25.475939+0000","last_clean":"2024-09-18T00:34:25.475939+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:25.475939+0000","last_undegraded":"2024-09-18T00:34:25.475939+0000","last_fullsized":"2024-09-18T00:34:25.475939+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:21:17.217607+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"150'681","reported_seq":3578,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816179+0000","last_change":"2024-09-18T00:34:11.024249+0000","last_active":"2024-09-18T00:34:25.816179+0000","last_peered":"2024-09-18T00:34:25.816179+0000","last_clean":"2024-09-18T00:34:25.816179+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:25.816179+0000","last_undegraded":"2024-09-18T00:34:25.816179+0000","last_fullsized":"2024-09-18T00:34:25.816179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:31.836839+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"145'618","reported_seq":5715,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232119+0000","last_change":"2024-09-18T00:33:58.855576+0000","last_active":"2024-09-18T00:34:25.232119+0000","last_peered":"2024-09-18T00:34:25.232119+0000","last_clean":"2024-09-18T00:34:25.232119+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:25.232119+0000","last_undegraded":"2024-09-18T00:34:25.232119+0000","last_fullsized":"2024-09-18T00:34:25.232119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:47.459464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"143'471","reported_seq":6472,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992548+0000","last_change":"2024-09-18T00:33:58.846364+0000","last_active":"2024-09-18T00:34:24.992548+0000","last_peered":"2024-09-18T00:34:24.992548+0000","last_clean":"2024-09-18T00:34:24.992548+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:24.992548+0000","last_undegraded":"2024-09-18T00:34:24.992548+0000","last_fullsized":"2024-09-18T00:34:24.992548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:19.394023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370994+0000","last_change":"2024-09-18T00:33:22.779457+0000","last_active":"2024-09-18T00:34:25.370994+0000","last_peered":"2024-09-18T00:34:25.370994+0000","last_clean":"2024-09-18T00:34:25.370994+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:25.370994+0000","last_undegraded":"2024-09-18T00:34:25.370994+0000","last_fullsized":"2024-09-18T00:34:25.370994+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:32.956130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'367","reported_seq":2490,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475890+0000","last_change":"2024-09-18T00:33:58.875581+0000","last_active":"2024-09-18T00:34:25.475890+0000","last_peered":"2024-09-18T00:34:25.475890+0000","last_clean":"2024-09-18T00:34:25.475890+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:25.475890+0000","last_undegraded":"2024-09-18T00:34:25.475890+0000","last_fullsized":"2024-09-18T00:34:25.475890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:26.615195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991955+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:34:24.991955+0000","last_peered":"2024-09-18T00:34:24.991955+0000","last_clean":"2024-09-18T00:34:24.991955+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:24.991955+0000","last_undegraded":"2024-09-18T00:34:24.991955+0000","last_fullsized":"2024-09-18T00:34:24.991955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"144'541","reported_seq":3815,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817270+0000","last_change":"2024-09-18T00:33:58.915231+0000","last_active":"2024-09-18T00:34:25.817270+0000","last_peered":"2024-09-18T00:34:25.817270+0000","last_clean":"2024-09-18T00:34:25.817270+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:25.817270+0000","last_undegraded":"2024-09-18T00:34:25.817270+0000","last_fullsized":"2024-09-18T00:34:25.817270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:15:00.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232230+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:34:25.232230+0000","last_peered":"2024-09-18T00:34:25.232230+0000","last_clean":"2024-09-18T00:34:25.232230+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:25.232230+0000","last_undegraded":"2024-09-18T00:34:25.232230+0000","last_fullsized":"2024-09-18T00:34:25.232230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"145'604","reported_seq":4126,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991748+0000","last_change":"2024-09-18T00:33:58.844330+0000","last_active":"2024-09-18T00:34:24.991748+0000","last_peered":"2024-09-18T00:34:24.991748+0000","last_clean":"2024-09-18T00:34:24.991748+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:24.991748+0000","last_undegraded":"2024-09-18T00:34:24.991748+0000","last_fullsized":"2024-09-18T00:34:24.991748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:38:44.367873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991859+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:34:24.991859+0000","last_peered":"2024-09-18T00:34:24.991859+0000","last_clean":"2024-09-18T00:34:24.991859+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:24.991859+0000","last_undegraded":"2024-09-18T00:34:24.991859+0000","last_fullsized":"2024-09-18T00:34:24.991859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'1052","reported_seq":5279,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816126+0000","last_change":"2024-09-18T00:34:11.145910+0000","last_active":"2024-09-18T00:34:25.816126+0000","last_peered":"2024-09-18T00:34:25.816126+0000","last_clean":"2024-09-18T00:34:25.816126+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:25.816126+0000","last_undegraded":"2024-09-18T00:34:25.816126+0000","last_fullsized":"2024-09-18T00:34:25.816126+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:23.247998+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"145'644","reported_seq":3564,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992505+0000","last_change":"2024-09-18T00:33:58.848118+0000","last_active":"2024-09-18T00:34:24.992505+0000","last_peered":"2024-09-18T00:34:24.992505+0000","last_clean":"2024-09-18T00:34:24.992505+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:24.992505+0000","last_undegraded":"2024-09-18T00:34:24.992505+0000","last_fullsized":"2024-09-18T00:34:24.992505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:48.142039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":227,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816105+0000","last_change":"2024-09-18T00:34:10.900377+0000","last_active":"2024-09-18T00:34:25.816105+0000","last_peered":"2024-09-18T00:34:25.816105+0000","last_clean":"2024-09-18T00:34:25.816105+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:25.816105+0000","last_undegraded":"2024-09-18T00:34:25.816105+0000","last_fullsized":"2024-09-18T00:34:25.816105+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:16.361358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"143'429","reported_seq":2440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991742+0000","last_change":"2024-09-18T00:33:58.844266+0000","last_active":"2024-09-18T00:34:24.991742+0000","last_peered":"2024-09-18T00:34:24.991742+0000","last_clean":"2024-09-18T00:34:24.991742+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:24.991742+0000","last_undegraded":"2024-09-18T00:34:24.991742+0000","last_fullsized":"2024-09-18T00:34:24.991742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:00.303484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992564+0000","last_change":"2024-09-18T00:34:16.067443+0000","last_active":"2024-09-18T00:34:24.992564+0000","last_peered":"2024-09-18T00:34:24.992564+0000","last_clean":"2024-09-18T00:34:24.992564+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:24.992564+0000","last_undegraded":"2024-09-18T00:34:24.992564+0000","last_fullsized":"2024-09-18T00:34:24.992564+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:19.940854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"144'620","reported_seq":9388,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475742+0000","last_change":"2024-09-18T00:34:11.899578+0000","last_active":"2024-09-18T00:34:25.475742+0000","last_peered":"2024-09-18T00:34:25.475742+0000","last_clean":"2024-09-18T00:34:25.475742+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:25.475742+0000","last_undegraded":"2024-09-18T00:34:25.475742+0000","last_fullsized":"2024-09-18T00:34:25.475742+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:25.964690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231895+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:34:25.231895+0000","last_peered":"2024-09-18T00:34:25.231895+0000","last_clean":"2024-09-18T00:34:25.231895+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:25.231895+0000","last_undegraded":"2024-09-18T00:34:25.231895+0000","last_fullsized":"2024-09-18T00:34:25.231895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"150'526","reported_seq":5711,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817581+0000","last_change":"2024-09-18T00:34:10.982307+0000","last_active":"2024-09-18T00:34:25.817581+0000","last_peered":"2024-09-18T00:34:25.817581+0000","last_clean":"2024-09-18T00:34:25.817581+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:25.817581+0000","last_undegraded":"2024-09-18T00:34:25.817581+0000","last_fullsized":"2024-09-18T00:34:25.817581+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:05.019472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":226,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816106+0000","last_change":"2024-09-18T00:34:10.900639+0000","last_active":"2024-09-18T00:34:25.816106+0000","last_peered":"2024-09-18T00:34:25.816106+0000","last_clean":"2024-09-18T00:34:25.816106+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:25.816106+0000","last_undegraded":"2024-09-18T00:34:25.816106+0000","last_fullsized":"2024-09-18T00:34:25.816106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:23.353390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":456,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232029+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:34:25.232029+0000","last_peered":"2024-09-18T00:34:25.232029+0000","last_clean":"2024-09-18T00:34:25.232029+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:25.232029+0000","last_undegraded":"2024-09-18T00:34:25.232029+0000","last_fullsized":"2024-09-18T00:34:25.232029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"144'556","reported_seq":8024,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817466+0000","last_change":"2024-09-18T00:33:58.915754+0000","last_active":"2024-09-18T00:34:25.817466+0000","last_peered":"2024-09-18T00:34:25.817466+0000","last_clean":"2024-09-18T00:34:25.817466+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:25.817466+0000","last_undegraded":"2024-09-18T00:34:25.817466+0000","last_fullsized":"2024-09-18T00:34:25.817466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:05:29.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"144'559","reported_seq":8539,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992477+0000","last_change":"2024-09-18T00:33:58.847033+0000","last_active":"2024-09-18T00:34:24.992477+0000","last_peered":"2024-09-18T00:34:24.992477+0000","last_clean":"2024-09-18T00:34:24.992477+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:24.992477+0000","last_undegraded":"2024-09-18T00:34:24.992477+0000","last_fullsized":"2024-09-18T00:34:24.992477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:45.459931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"144'431","reported_seq":6440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370966+0000","last_change":"2024-09-18T00:33:58.841509+0000","last_active":"2024-09-18T00:34:25.370966+0000","last_peered":"2024-09-18T00:34:25.370966+0000","last_clean":"2024-09-18T00:34:25.370966+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:25.370966+0000","last_undegraded":"2024-09-18T00:34:25.370966+0000","last_fullsized":"2024-09-18T00:34:25.370966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:31.149905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"143'703","reported_seq":5579,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816837+0000","last_change":"2024-09-18T00:33:58.914778+0000","last_active":"2024-09-18T00:34:25.816837+0000","last_peered":"2024-09-18T00:34:25.816837+0000","last_clean":"2024-09-18T00:34:25.816837+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:25.816837+0000","last_undegraded":"2024-09-18T00:34:25.816837+0000","last_fullsized":"2024-09-18T00:34:25.816837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:07.031351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"150'371","reported_seq":4927,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816137+0000","last_change":"2024-09-18T00:34:11.173631+0000","last_active":"2024-09-18T00:34:25.816137+0000","last_peered":"2024-09-18T00:34:25.816137+0000","last_clean":"2024-09-18T00:34:25.816137+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:25.816137+0000","last_undegraded":"2024-09-18T00:34:25.816137+0000","last_fullsized":"2024-09-18T00:34:25.816137+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:12.847767+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"150'650","reported_seq":7010,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232084+0000","last_change":"2024-09-18T00:34:11.058471+0000","last_active":"2024-09-18T00:34:25.232084+0000","last_peered":"2024-09-18T00:34:25.232084+0000","last_clean":"2024-09-18T00:34:25.232084+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:25.232084+0000","last_undegraded":"2024-09-18T00:34:25.232084+0000","last_fullsized":"2024-09-18T00:34:25.232084+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:39.182028+0000","scrub_duration":0,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"144'773","reported_seq":11334,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232147+0000","last_change":"2024-09-18T00:33:58.856451+0000","last_active":"2024-09-18T00:34:25.232147+0000","last_peered":"2024-09-18T00:34:25.232147+0000","last_clean":"2024-09-18T00:34:25.232147+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:25.232147+0000","last_undegraded":"2024-09-18T00:34:25.232147+0000","last_fullsized":"2024-09-18T00:34:25.232147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:14.838716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"143'638","reported_seq":6380,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232174+0000","last_change":"2024-09-18T00:33:58.856397+0000","last_active":"2024-09-18T00:34:25.232174+0000","last_peered":"2024-09-18T00:34:25.232174+0000","last_clean":"2024-09-18T00:34:25.232174+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:25.232174+0000","last_undegraded":"2024-09-18T00:34:25.232174+0000","last_fullsized":"2024-09-18T00:34:25.232174+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:14.859123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"143'600","reported_seq":5223,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991638+0000","last_change":"2024-09-18T00:33:58.843666+0000","last_active":"2024-09-18T00:34:24.991638+0000","last_peered":"2024-09-18T00:34:24.991638+0000","last_clean":"2024-09-18T00:34:24.991638+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:24.991638+0000","last_undegraded":"2024-09-18T00:34:24.991638+0000","last_fullsized":"2024-09-18T00:34:24.991638+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:25.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"143'1369","reported_seq":6537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231968+0000","last_change":"2024-09-18T00:33:58.855500+0000","last_active":"2024-09-18T00:34:25.231968+0000","last_peered":"2024-09-18T00:34:25.231968+0000","last_clean":"2024-09-18T00:34:25.231968+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:25.231968+0000","last_undegraded":"2024-09-18T00:34:25.231968+0000","last_fullsized":"2024-09-18T00:34:25.231968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:16.993051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"143'580","reported_seq":7338,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475751+0000","last_change":"2024-09-18T00:34:11.900518+0000","last_active":"2024-09-18T00:34:25.475751+0000","last_peered":"2024-09-18T00:34:25.475751+0000","last_clean":"2024-09-18T00:34:25.475751+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:25.475751+0000","last_undegraded":"2024-09-18T00:34:25.475751+0000","last_fullsized":"2024-09-18T00:34:25.475751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:57.839332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"143'736","reported_seq":4221,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231997+0000","last_change":"2024-09-18T00:33:58.854818+0000","last_active":"2024-09-18T00:34:25.231997+0000","last_peered":"2024-09-18T00:34:25.231997+0000","last_clean":"2024-09-18T00:34:25.231997+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:25.231997+0000","last_undegraded":"2024-09-18T00:34:25.231997+0000","last_fullsized":"2024-09-18T00:34:25.231997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:20.262640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20612,"ondisk_log_size":20612,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59528,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312312,"statfs":{"total":96636764160,"available":96575807488,"internally_reserved":0,"allocated":2011136,"data_stored":1532213,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127110,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30684,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341156,"statfs":{"total":96636764160,"available":96605343744,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28964,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342876,"statfs":{"total":96636764160,"available":96607105024,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:30.735 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T00:34:30.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-18T00:34:29.068736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20732,"ondisk_log_size":20732,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369444,"kb_used_data":15452,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605276,"statfs":{"total":773094113280,"available":772715802624,"internally_reserved":0,"allocated":15822848,"data_stored":8744927,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.088127"},"pg_stats":[{"pgid":"3.1f","version":"151'540","reported_seq":6064,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475897+0000","last_change":"2024-09-18T00:34:11.968109+0000","last_active":"2024-09-18T00:34:25.475897+0000","last_peered":"2024-09-18T00:34:25.475897+0000","last_clean":"2024-09-18T00:34:25.475897+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:25.475897+0000","last_undegraded":"2024-09-18T00:34:25.475897+0000","last_fullsized":"2024-09-18T00:34:25.475897+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:45.083482+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"143'619","reported_seq":4297,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817153+0000","last_change":"2024-09-18T00:33:58.914896+0000","last_active":"2024-09-18T00:34:25.817153+0000","last_peered":"2024-09-18T00:34:25.817153+0000","last_clean":"2024-09-18T00:34:25.817153+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:25.817153+0000","last_undegraded":"2024-09-18T00:34:25.817153+0000","last_fullsized":"2024-09-18T00:34:25.817153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:11.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"150'622","reported_seq":6838,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816129+0000","last_change":"2024-09-18T00:34:10.990561+0000","last_active":"2024-09-18T00:34:25.816129+0000","last_peered":"2024-09-18T00:34:25.816129+0000","last_clean":"2024-09-18T00:34:25.816129+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:25.816129+0000","last_undegraded":"2024-09-18T00:34:25.816129+0000","last_fullsized":"2024-09-18T00:34:25.816129+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:45.279057+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"150'791","reported_seq":6596,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816177+0000","last_change":"2024-09-18T00:34:11.109534+0000","last_active":"2024-09-18T00:34:25.816177+0000","last_peered":"2024-09-18T00:34:25.816177+0000","last_clean":"2024-09-18T00:34:25.816177+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:25.816177+0000","last_undegraded":"2024-09-18T00:34:25.816177+0000","last_fullsized":"2024-09-18T00:34:25.816177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:41.803194+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"143'851","reported_seq":4070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475836+0000","last_change":"2024-09-18T00:34:11.899310+0000","last_active":"2024-09-18T00:34:25.475836+0000","last_peered":"2024-09-18T00:34:25.475836+0000","last_clean":"2024-09-18T00:34:25.475836+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:25.475836+0000","last_undegraded":"2024-09-18T00:34:25.475836+0000","last_fullsized":"2024-09-18T00:34:25.475836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:41.721082+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"145'429","reported_seq":10537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992627+0000","last_change":"2024-09-18T00:33:58.847282+0000","last_active":"2024-09-18T00:34:24.992627+0000","last_peered":"2024-09-18T00:34:24.992627+0000","last_clean":"2024-09-18T00:34:24.992627+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:24.992627+0000","last_undegraded":"2024-09-18T00:34:24.992627+0000","last_fullsized":"2024-09-18T00:34:24.992627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:47.743442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"143'733","reported_seq":2759,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991697+0000","last_change":"2024-09-18T00:33:58.843733+0000","last_active":"2024-09-18T00:34:24.991697+0000","last_peered":"2024-09-18T00:34:24.991697+0000","last_clean":"2024-09-18T00:34:24.991697+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:24.991697+0000","last_undegraded":"2024-09-18T00:34:24.991697+0000","last_fullsized":"2024-09-18T00:34:24.991697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:06.718931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"143'451","reported_seq":6055,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817376+0000","last_change":"2024-09-18T00:33:58.915285+0000","last_active":"2024-09-18T00:34:25.817376+0000","last_peered":"2024-09-18T00:34:25.817376+0000","last_clean":"2024-09-18T00:34:25.817376+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:25.817376+0000","last_undegraded":"2024-09-18T00:34:25.817376+0000","last_fullsized":"2024-09-18T00:34:25.817376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:50:01.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'1057","reported_seq":5231,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475939+0000","last_change":"2024-09-18T00:34:11.943349+0000","last_active":"2024-09-18T00:34:25.475939+0000","last_peered":"2024-09-18T00:34:25.475939+0000","last_clean":"2024-09-18T00:34:25.475939+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:25.475939+0000","last_undegraded":"2024-09-18T00:34:25.475939+0000","last_fullsized":"2024-09-18T00:34:25.475939+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:21:17.217607+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"150'681","reported_seq":3578,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816179+0000","last_change":"2024-09-18T00:34:11.024249+0000","last_active":"2024-09-18T00:34:25.816179+0000","last_peered":"2024-09-18T00:34:25.816179+0000","last_clean":"2024-09-18T00:34:25.816179+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:25.816179+0000","last_undegraded":"2024-09-18T00:34:25.816179+0000","last_fullsized":"2024-09-18T00:34:25.816179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:31.836839+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"145'618","reported_seq":5715,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232119+0000","last_change":"2024-09-18T00:33:58.855576+0000","last_active":"2024-09-18T00:34:25.232119+0000","last_peered":"2024-09-18T00:34:25.232119+0000","last_clean":"2024-09-18T00:34:25.232119+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:25.232119+0000","last_undegraded":"2024-09-18T00:34:25.232119+0000","last_fullsized":"2024-09-18T00:34:25.232119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:47.459464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"143'471","reported_seq":6472,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992548+0000","last_change":"2024-09-18T00:33:58.846364+0000","last_active":"2024-09-18T00:34:24.992548+0000","last_peered":"2024-09-18T00:34:24.992548+0000","last_clean":"2024-09-18T00:34:24.992548+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:24.992548+0000","last_undegraded":"2024-09-18T00:34:24.992548+0000","last_fullsized":"2024-09-18T00:34:24.992548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:19.394023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370994+0000","last_change":"2024-09-18T00:33:22.779457+0000","last_active":"2024-09-18T00:34:25.370994+0000","last_peered":"2024-09-18T00:34:25.370994+0000","last_clean":"2024-09-18T00:34:25.370994+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:25.370994+0000","last_undegraded":"2024-09-18T00:34:25.370994+0000","last_fullsized":"2024-09-18T00:34:25.370994+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:32.956130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'367","reported_seq":2490,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475890+0000","last_change":"2024-09-18T00:33:58.875581+0000","last_active":"2024-09-18T00:34:25.475890+0000","last_peered":"2024-09-18T00:34:25.475890+0000","last_clean":"2024-09-18T00:34:25.475890+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:25.475890+0000","last_undegraded":"2024-09-18T00:34:25.475890+0000","last_fullsized":"2024-09-18T00:34:25.475890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:26.615195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991955+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:34:24.991955+0000","last_peered":"2024-09-18T00:34:24.991955+0000","last_clean":"2024-09-18T00:34:24.991955+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:24.991955+0000","last_undegraded":"2024-09-18T00:34:24.991955+0000","last_fullsized":"2024-09-18T00:34:24.991955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"144'541","reported_seq":3815,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817270+0000","last_change":"2024-09-18T00:33:58.915231+0000","last_active":"2024-09-18T00:34:25.817270+0000","last_peered":"2024-09-18T00:34:25.817270+0000","last_clean":"2024-09-18T00:34:25.817270+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:25.817270+0000","last_undegraded":"2024-09-18T00:34:25.817270+0000","last_fullsized":"2024-09-18T00:34:25.817270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:15:00.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232230+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:34:25.232230+0000","last_peered":"2024-09-18T00:34:25.232230+0000","last_clean":"2024-09-18T00:34:25.232230+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:25.232230+0000","last_undegraded":"2024-09-18T00:34:25.232230+0000","last_fullsized":"2024-09-18T00:34:25.232230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"145'604","reported_seq":4126,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991748+0000","last_change":"2024-09-18T00:33:58.844330+0000","last_active":"2024-09-18T00:34:24.991748+0000","last_peered":"2024-09-18T00:34:24.991748+0000","last_clean":"2024-09-18T00:34:24.991748+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:24.991748+0000","last_undegraded":"2024-09-18T00:34:24.991748+0000","last_fullsized":"2024-09-18T00:34:24.991748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:38:44.367873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991859+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:34:24.991859+0000","last_peered":"2024-09-18T00:34:24.991859+0000","last_clean":"2024-09-18T00:34:24.991859+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:24.991859+0000","last_undegraded":"2024-09-18T00:34:24.991859+0000","last_fullsized":"2024-09-18T00:34:24.991859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'1052","reported_seq":5279,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816126+0000","last_change":"2024-09-18T00:34:11.145910+0000","last_active":"2024-09-18T00:34:25.816126+0000","last_peered":"2024-09-18T00:34:25.816126+0000","last_clean":"2024-09-18T00:34:25.816126+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:25.816126+0000","last_undegraded":"2024-09-18T00:34:25.816126+0000","last_fullsized":"2024-09-18T00:34:25.816126+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:23.247998+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"145'644","reported_seq":3564,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992505+0000","last_change":"2024-09-18T00:33:58.848118+0000","last_active":"2024-09-18T00:34:24.992505+0000","last_peered":"2024-09-18T00:34:24.992505+0000","last_clean":"2024-09-18T00:34:24.992505+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:24.992505+0000","last_undegraded":"2024-09-18T00:34:24.992505+0000","last_fullsized":"2024-09-18T00:34:24.992505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:48.142039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":227,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816105+0000","last_change":"2024-09-18T00:34:10.900377+0000","last_active":"2024-09-18T00:34:25.816105+0000","last_peered":"2024-09-18T00:34:25.816105+0000","last_clean":"2024-09-18T00:34:25.816105+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:25.816105+0000","last_undegraded":"2024-09-18T00:34:25.816105+0000","last_fullsized":"2024-09-18T00:34:25.816105+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:16.361358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"143'429","reported_seq":2440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991742+0000","last_change":"2024-09-18T00:33:58.844266+0000","last_active":"2024-09-18T00:34:24.991742+0000","last_peered":"2024-09-18T00:34:24.991742+0000","last_clean":"2024-09-18T00:34:24.991742+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:24.991742+0000","last_undegraded":"2024-09-18T00:34:24.991742+0000","last_fullsized":"2024-09-18T00:34:24.991742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:00.303484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992564+0000","last_change":"2024-09-18T00:34:16.067443+0000","last_active":"2024-09-18T00:34:24.992564+0000","last_peered":"2024-09-18T00:34:24.992564+0000","last_clean":"2024-09-18T00:34:24.992564+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:24.992564+0000","last_undegraded":"2024-09-18T00:34:24.992564+0000","last_fullsized":"2024-09-18T00:34:24.992564+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:19.940854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"144'620","reported_seq":9388,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475742+0000","last_change":"2024-09-18T00:34:11.899578+0000","last_active":"2024-09-18T00:34:25.475742+0000","last_peered":"2024-09-18T00:34:25.475742+0000","last_clean":"2024-09-18T00:34:25.475742+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:25.475742+0000","last_undegraded":"2024-09-18T00:34:25.475742+0000","last_fullsized":"2024-09-18T00:34:25.475742+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:25.964690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231895+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:34:25.231895+0000","last_peered":"2024-09-18T00:34:25.231895+0000","last_clean":"2024-09-18T00:34:25.231895+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:25.231895+0000","last_undegraded":"2024-09-18T00:34:25.231895+0000","last_fullsized":"2024-09-18T00:34:25.231895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"150'526","reported_seq":5711,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817581+0000","last_change":"2024-09-18T00:34:10.982307+0000","last_active":"2024-09-18T00:34:25.817581+0000","last_peered":"2024-09-18T00:34:25.817581+0000","last_clean":"2024-09-18T00:34:25.817581+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:25.817581+0000","last_undegraded":"2024-09-18T00:34:25.817581+0000","last_fullsized":"2024-09-18T00:34:25.817581+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:15:05.019472+0000","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":226,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816106+0000","last_change":"2024-09-18T00:34:10.900639+0000","last_active":"2024-09-18T00:34:25.816106+0000","last_peered":"2024-09-18T00:34:25.816106+0000","last_clean":"2024-09-18T00:34:25.816106+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:25.816106+0000","last_undegraded":"2024-09-18T00:34:25.816106+0000","last_fullsized":"2024-09-18T00:34:25.816106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:23.353390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":456,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232029+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:34:25.232029+0000","last_peered":"2024-09-18T00:34:25.232029+0000","last_clean":"2024-09-18T00:34:25.232029+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:25.232029+0000","last_undegraded":"2024-09-18T00:34:25.232029+0000","last_fullsized":"2024-09-18T00:34:25.232029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"144'556","reported_seq":8024,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817466+0000","last_change":"2024-09-18T00:33:58.915754+0000","last_active":"2024-09-18T00:34:25.817466+0000","last_peered":"2024-09-18T00:34:25.817466+0000","last_clean":"2024-09-18T00:34:25.817466+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:25.817466+0000","last_undegraded":"2024-09-18T00:34:25.817466+0000","last_fullsized":"2024-09-18T00:34:25.817466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:05:29.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"144'559","reported_seq":8539,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992477+0000","last_change":"2024-09-18T00:33:58.847033+0000","last_active":"2024-09-18T00:34:24.992477+0000","last_peered":"2024-09-18T00:34:24.992477+0000","last_clean":"2024-09-18T00:34:24.992477+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:24.992477+0000","last_undegraded":"2024-09-18T00:34:24.992477+0000","last_fullsized":"2024-09-18T00:34:24.992477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:45.459931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"144'431","reported_seq":6440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370966+0000","last_change":"2024-09-18T00:33:58.841509+0000","last_active":"2024-09-18T00:34:25.370966+0000","last_peered":"2024-09-18T00:34:25.370966+0000","last_clean":"2024-09-18T00:34:25.370966+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:25.370966+0000","last_undegraded":"2024-09-18T00:34:25.370966+0000","last_fullsized":"2024-09-18T00:34:25.370966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:31.149905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"143'703","reported_seq":5579,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816837+0000","last_change":"2024-09-18T00:33:58.914778+0000","last_active":"2024-09-18T00:34:25.816837+0000","last_peered":"2024-09-18T00:34:25.816837+0000","last_clean":"2024-09-18T00:34:25.816837+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:25.816837+0000","last_undegraded":"2024-09-18T00:34:25.816837+0000","last_fullsized":"2024-09-18T00:34:25.816837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:07.031351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"150'371","reported_seq":4927,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816137+0000","last_change":"2024-09-18T00:34:11.173631+0000","last_active":"2024-09-18T00:34:25.816137+0000","last_peered":"2024-09-18T00:34:25.816137+0000","last_clean":"2024-09-18T00:34:25.816137+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:25.816137+0000","last_undegraded":"2024-09-18T00:34:25.816137+0000","last_fullsized":"2024-09-18T00:34:25.816137+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:12.847767+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"150'650","reported_seq":7010,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232084+0000","last_change":"2024-09-18T00:34:11.058471+0000","last_active":"2024-09-18T00:34:25.232084+0000","last_peered":"2024-09-18T00:34:25.232084+0000","last_clean":"2024-09-18T00:34:25.232084+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:25.232084+0000","last_undegraded":"2024-09-18T00:34:25.232084+0000","last_fullsized":"2024-09-18T00:34:25.232084+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:39.182028+0000","scrub_duration":0,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"144'773","reported_seq":11334,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232147+0000","last_change":"2024-09-18T00:33:58.856451+0000","last_active":"2024-09-18T00:34:25.232147+0000","last_peered":"2024-09-18T00:34:25.232147+0000","last_clean":"2024-09-18T00:34:25.232147+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:25.232147+0000","last_undegraded":"2024-09-18T00:34:25.232147+0000","last_fullsized":"2024-09-18T00:34:25.232147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:14.838716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"143'638","reported_seq":6380,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232174+0000","last_change":"2024-09-18T00:33:58.856397+0000","last_active":"2024-09-18T00:34:25.232174+0000","last_peered":"2024-09-18T00:34:25.232174+0000","last_clean":"2024-09-18T00:34:25.232174+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:25.232174+0000","last_undegraded":"2024-09-18T00:34:25.232174+0000","last_fullsized":"2024-09-18T00:34:25.232174+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:14.859123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"143'600","reported_seq":5223,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991638+0000","last_change":"2024-09-18T00:33:58.843666+0000","last_active":"2024-09-18T00:34:24.991638+0000","last_peered":"2024-09-18T00:34:24.991638+0000","last_clean":"2024-09-18T00:34:24.991638+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:24.991638+0000","last_undegraded":"2024-09-18T00:34:24.991638+0000","last_fullsized":"2024-09-18T00:34:24.991638+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:25.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"143'1369","reported_seq":6537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231968+0000","last_change":"2024-09-18T00:33:58.855500+0000","last_active":"2024-09-18T00:34:25.231968+0000","last_peered":"2024-09-18T00:34:25.231968+0000","last_clean":"2024-09-18T00:34:25.231968+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:25.231968+0000","last_undegraded":"2024-09-18T00:34:25.231968+0000","last_fullsized":"2024-09-18T00:34:25.231968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:16.993051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"143'580","reported_seq":7338,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475751+0000","last_change":"2024-09-18T00:34:11.900518+0000","last_active":"2024-09-18T00:34:25.475751+0000","last_peered":"2024-09-18T00:34:25.475751+0000","last_clean":"2024-09-18T00:34:25.475751+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:25.475751+0000","last_undegraded":"2024-09-18T00:34:25.475751+0000","last_fullsized":"2024-09-18T00:34:25.475751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:57.839332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"143'736","reported_seq":4221,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231997+0000","last_change":"2024-09-18T00:33:58.854818+0000","last_active":"2024-09-18T00:34:25.231997+0000","last_peered":"2024-09-18T00:34:25.231997+0000","last_clean":"2024-09-18T00:34:25.231997+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:25.231997+0000","last_undegraded":"2024-09-18T00:34:25.231997+0000","last_fullsized":"2024-09-18T00:34:25.231997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:20.262640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20612,"ondisk_log_size":20612,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59528,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312312,"statfs":{"total":96636764160,"available":96575807488,"internally_reserved":0,"allocated":2011136,"data_stored":1532213,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127110,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30684,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341156,"statfs":{"total":96636764160,"available":96605343744,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28964,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342876,"statfs":{"total":96636764160,"available":96607105024,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55308,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316532,"statfs":{"total":96636764160,"available":96580128768,"internally_reserved":0,"allocated":1953792,"data_stored":941845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:31.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T00:34:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:31.305 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":164,"fsid":"1111294f-f881-4427-a507-2f6f0939f89f","created":"2024-09-18T00:31:16.967705+0000","modified":"2024-09-18T00:34:24.988354+0000","last_up_change":"2024-09-18T00:34:09.887078+0000","last_in_change":"2024-09-18T00:31:19.984105+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T00:31:29.068996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T00:31:35.737341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-18T00:31:45.237398+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":52,"snap_epoch":145,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3f5415f-ac86-4dd6-8c50-5391b44b9c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6803","nonce":2689107883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6805","nonce":2689107883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6809","nonce":2689107883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2689107883},{"type":"v1","addr":"172.21.15.81:6807","nonce":2689107883}]},"public_addr":"172.21.15.81:6803/2689107883","cluster_addr":"172.21.15.81:6805/2689107883","heartbeat_back_addr":"172.21.15.81:6809/2689107883","heartbeat_front_addr":"172.21.15.81:6807/2689107883","state":["exists","up"]},{"osd":1,"uuid":"06a47ef1-1ae7-40a2-a998-daac122fc229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6813","nonce":1726163291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6817","nonce":1726163291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6825","nonce":1726163291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6819","nonce":1726163291},{"type":"v1","addr":"172.21.15.81:6821","nonce":1726163291}]},"public_addr":"172.21.15.81:6813/1726163291","cluster_addr":"172.21.15.81:6817/1726163291","heartbeat_back_addr":"172.21.15.81:6825/1726163291","heartbeat_front_addr":"172.21.15.81:6821/1726163291","state":["exists","up"]},{"osd":2,"uuid":"653ab61a-1037-4190-8806-7042ef3d0586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6812","nonce":365910818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6816","nonce":365910818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6824","nonce":365910818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":365910818},{"type":"v1","addr":"172.21.15.81:6820","nonce":365910818}]},"public_addr":"172.21.15.81:6812/365910818","cluster_addr":"172.21.15.81:6816/365910818","heartbeat_back_addr":"172.21.15.81:6824/365910818","heartbeat_front_addr":"172.21.15.81:6820/365910818","state":["exists","up"]},{"osd":3,"uuid":"b7c0c1fa-81b9-4113-a6fe-fa0cf0bd146f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6827","nonce":2780316581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6829","nonce":2780316581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6833","nonce":2780316581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2780316581},{"type":"v1","addr":"172.21.15.81:6831","nonce":2780316581}]},"public_addr":"172.21.15.81:6827/2780316581","cluster_addr":"172.21.15.81:6829/2780316581","heartbeat_back_addr":"172.21.15.81:6833/2780316581","heartbeat_front_addr":"172.21.15.81:6831/2780316581","state":["exists","up"]},{"osd":4,"uuid":"7000f249-35b4-4770-8452-8f31064ef1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6825","nonce":2008948201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6827","nonce":2008948201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6831","nonce":2008948201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2008948201},{"type":"v1","addr":"172.21.15.167:6829","nonce":2008948201}]},"public_addr":"172.21.15.167:6825/2008948201","cluster_addr":"172.21.15.167:6827/2008948201","heartbeat_back_addr":"172.21.15.167:6831/2008948201","heartbeat_front_addr":"172.21.15.167:6829/2008948201","state":["exists","up"]},{"osd":5,"uuid":"755442b3-b418-409d-bd0a-376579eeb381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":124,"up_from":149,"up_thru":149,"down_at":125,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6817","nonce":1730328106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6819","nonce":1730328106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6823","nonce":1730328106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":1730328106},{"type":"v1","addr":"172.21.15.167:6821","nonce":1730328106}]},"public_addr":"172.21.15.167:6817/1730328106","cluster_addr":"172.21.15.167:6819/1730328106","heartbeat_back_addr":"172.21.15.167:6823/1730328106","heartbeat_front_addr":"172.21.15.167:6821/1730328106","state":["exists","up"]},{"osd":6,"uuid":"6b406b2b-e850-41be-bce8-9f13d2921c60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6801","nonce":2657673991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6803","nonce":2657673991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6807","nonce":2657673991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2657673991},{"type":"v1","addr":"172.21.15.167:6805","nonce":2657673991}]},"public_addr":"172.21.15.167:6801/2657673991","cluster_addr":"172.21.15.167:6803/2657673991","heartbeat_back_addr":"172.21.15.167:6807/2657673991","heartbeat_front_addr":"172.21.15.167:6805/2657673991","state":["exists","up"]},{"osd":7,"uuid":"8bb8987f-d8e4-494e-82ce-e1203957c35f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6809","nonce":2652298701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6811","nonce":2652298701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6815","nonce":2652298701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2652298701},{"type":"v1","addr":"172.21.15.167:6813","nonce":2652298701}]},"public_addr":"172.21.15.167:6809/2652298701","cluster_addr":"172.21.15.167:6811/2652298701","heartbeat_back_addr":"172.21.15.167:6815/2652298701","heartbeat_front_addr":"172.21.15.167:6813/2652298701","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.022758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:27.126737+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.574908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.569036+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.436338+0000","dead_epoch":125},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.050552+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T00:31:26.299077+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.10","osds":[1,4]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T00:34:32.318 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T00:34:32.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:32.454 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:32.454 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:32.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T00:34:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T00:34:32.753 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T00:34:32.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:32.876 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:32.876 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:32.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T00:34:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T00:34:33.177 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T00:34:33.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:33.300 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:33.300 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:33.300 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:33.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T00:34:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T00:34:33.603 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T00:34:33.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:33.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T00:34:34.015 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T00:34:34.029 INFO:tasks.ceph:Scrubbing osd.4 2024-09-18T00:34:34.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:34.152 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:34.152 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:34.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-18T00:34:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-18T00:34:34.457 INFO:tasks.ceph:Scrubbing osd.5 2024-09-18T00:34:34.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:34.581 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:34.581 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-18T00:34:34.581 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:34.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-18T00:34:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-18T00:34:34.880 INFO:tasks.ceph:Scrubbing osd.6 2024-09-18T00:34:34.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:35.005 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:35.005 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:35.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-18T00:34:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-18T00:34:35.306 INFO:tasks.ceph:Scrubbing osd.7 2024-09-18T00:34:35.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-18T00:34:35.430 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-18T00:34:35.430 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T00:34:35.430 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-18T00:34:35.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-18T00:34:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-18T00:34:35.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:36.013 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-18T00:34:35.069663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20732,"ondisk_log_size":20732,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369472,"kb_used_data":15488,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605248,"statfs":{"total":773094113280,"available":772715773952,"internally_reserved":0,"allocated":15859712,"data_stored":8762540,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.078278"},"pg_stats":[{"pgid":"3.1f","version":"151'540","reported_seq":6064,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475897+0000","last_change":"2024-09-18T00:34:11.968109+0000","last_active":"2024-09-18T00:34:25.475897+0000","last_peered":"2024-09-18T00:34:25.475897+0000","last_clean":"2024-09-18T00:34:25.475897+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:25.475897+0000","last_undegraded":"2024-09-18T00:34:25.475897+0000","last_fullsized":"2024-09-18T00:34:25.475897+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:43:45.083482+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"143'619","reported_seq":4298,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817196+0000","last_change":"2024-09-18T00:33:58.914896+0000","last_active":"2024-09-18T00:34:25.817196+0000","last_peered":"2024-09-18T00:34:25.817196+0000","last_clean":"2024-09-18T00:34:25.817196+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:25.817196+0000","last_undegraded":"2024-09-18T00:34:25.817196+0000","last_fullsized":"2024-09-18T00:34:25.817196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"150'622","reported_seq":6838,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816129+0000","last_change":"2024-09-18T00:34:10.990561+0000","last_active":"2024-09-18T00:34:25.816129+0000","last_peered":"2024-09-18T00:34:25.816129+0000","last_clean":"2024-09-18T00:34:25.816129+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:25.816129+0000","last_undegraded":"2024-09-18T00:34:25.816129+0000","last_fullsized":"2024-09-18T00:34:25.816129+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:45.279057+0000","scrub_duration":0,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"150'791","reported_seq":6596,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816177+0000","last_change":"2024-09-18T00:34:11.109534+0000","last_active":"2024-09-18T00:34:25.816177+0000","last_peered":"2024-09-18T00:34:25.816177+0000","last_clean":"2024-09-18T00:34:25.816177+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:25.816177+0000","last_undegraded":"2024-09-18T00:34:25.816177+0000","last_fullsized":"2024-09-18T00:34:25.816177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:35:41.803194+0000","scrub_duration":0,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"143'851","reported_seq":4070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475836+0000","last_change":"2024-09-18T00:34:11.899310+0000","last_active":"2024-09-18T00:34:25.475836+0000","last_peered":"2024-09-18T00:34:25.475836+0000","last_clean":"2024-09-18T00:34:25.475836+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:25.475836+0000","last_undegraded":"2024-09-18T00:34:25.475836+0000","last_fullsized":"2024-09-18T00:34:25.475836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:37:41.721082+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"145'429","reported_seq":10537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992627+0000","last_change":"2024-09-18T00:33:58.847282+0000","last_active":"2024-09-18T00:34:24.992627+0000","last_peered":"2024-09-18T00:34:24.992627+0000","last_clean":"2024-09-18T00:34:24.992627+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:24.992627+0000","last_undegraded":"2024-09-18T00:34:24.992627+0000","last_fullsized":"2024-09-18T00:34:24.992627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:58:47.743442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"143'733","reported_seq":2759,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991697+0000","last_change":"2024-09-18T00:33:58.843733+0000","last_active":"2024-09-18T00:34:24.991697+0000","last_peered":"2024-09-18T00:34:24.991697+0000","last_clean":"2024-09-18T00:34:24.991697+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:24.991697+0000","last_undegraded":"2024-09-18T00:34:24.991697+0000","last_fullsized":"2024-09-18T00:34:24.991697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:06.718931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"143'451","reported_seq":6056,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817418+0000","last_change":"2024-09-18T00:33:58.915285+0000","last_active":"2024-09-18T00:34:25.817418+0000","last_peered":"2024-09-18T00:34:25.817418+0000","last_clean":"2024-09-18T00:34:25.817418+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:25.817418+0000","last_undegraded":"2024-09-18T00:34:25.817418+0000","last_fullsized":"2024-09-18T00:34:25.817418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"151'1057","reported_seq":5231,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475939+0000","last_change":"2024-09-18T00:34:11.943349+0000","last_active":"2024-09-18T00:34:25.475939+0000","last_peered":"2024-09-18T00:34:25.475939+0000","last_clean":"2024-09-18T00:34:25.475939+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:25.475939+0000","last_undegraded":"2024-09-18T00:34:25.475939+0000","last_fullsized":"2024-09-18T00:34:25.475939+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1057,"log_dups_size":0,"ondisk_log_size":1057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:21:17.217607+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"150'681","reported_seq":3578,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816179+0000","last_change":"2024-09-18T00:34:11.024249+0000","last_active":"2024-09-18T00:34:25.816179+0000","last_peered":"2024-09-18T00:34:25.816179+0000","last_clean":"2024-09-18T00:34:25.816179+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:25.816179+0000","last_undegraded":"2024-09-18T00:34:25.816179+0000","last_fullsized":"2024-09-18T00:34:25.816179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:36:31.836839+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"145'618","reported_seq":5715,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232119+0000","last_change":"2024-09-18T00:33:58.855576+0000","last_active":"2024-09-18T00:34:25.232119+0000","last_peered":"2024-09-18T00:34:25.232119+0000","last_clean":"2024-09-18T00:34:25.232119+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:25.232119+0000","last_undegraded":"2024-09-18T00:34:25.232119+0000","last_fullsized":"2024-09-18T00:34:25.232119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:47.459464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"143'471","reported_seq":6472,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992548+0000","last_change":"2024-09-18T00:33:58.846364+0000","last_active":"2024-09-18T00:34:24.992548+0000","last_peered":"2024-09-18T00:34:24.992548+0000","last_clean":"2024-09-18T00:34:24.992548+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:24.992548+0000","last_undegraded":"2024-09-18T00:34:24.992548+0000","last_fullsized":"2024-09-18T00:34:24.992548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:32:19.394023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370994+0000","last_change":"2024-09-18T00:33:22.779457+0000","last_active":"2024-09-18T00:34:25.370994+0000","last_peered":"2024-09-18T00:34:25.370994+0000","last_clean":"2024-09-18T00:34:25.370994+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:25.370994+0000","last_undegraded":"2024-09-18T00:34:25.370994+0000","last_fullsized":"2024-09-18T00:34:25.370994+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:56:32.956130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"145'367","reported_seq":2490,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475890+0000","last_change":"2024-09-18T00:33:58.875581+0000","last_active":"2024-09-18T00:34:25.475890+0000","last_peered":"2024-09-18T00:34:25.475890+0000","last_clean":"2024-09-18T00:34:25.475890+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:25.475890+0000","last_undegraded":"2024-09-18T00:34:25.475890+0000","last_fullsized":"2024-09-18T00:34:25.475890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:26.615195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991955+0000","last_change":"2024-09-18T00:31:39.155404+0000","last_active":"2024-09-18T00:34:24.991955+0000","last_peered":"2024-09-18T00:34:24.991955+0000","last_clean":"2024-09-18T00:34:24.991955+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:24.991955+0000","last_undegraded":"2024-09-18T00:34:24.991955+0000","last_fullsized":"2024-09-18T00:34:24.991955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:10.558710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"144'541","reported_seq":3816,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817312+0000","last_change":"2024-09-18T00:33:58.915231+0000","last_active":"2024-09-18T00:34:25.817312+0000","last_peered":"2024-09-18T00:34:25.817312+0000","last_clean":"2024-09-18T00:34:25.817312+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:25.817312+0000","last_undegraded":"2024-09-18T00:34:25.817312+0000","last_fullsized":"2024-09-18T00:34:25.817312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232230+0000","last_change":"2024-09-18T00:31:39.227597+0000","last_active":"2024-09-18T00:34:25.232230+0000","last_peered":"2024-09-18T00:34:25.232230+0000","last_clean":"2024-09-18T00:34:25.232230+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:25.232230+0000","last_undegraded":"2024-09-18T00:34:25.232230+0000","last_fullsized":"2024-09-18T00:34:25.232230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:24.626339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"145'604","reported_seq":4126,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991748+0000","last_change":"2024-09-18T00:33:58.844330+0000","last_active":"2024-09-18T00:34:24.991748+0000","last_peered":"2024-09-18T00:34:24.991748+0000","last_clean":"2024-09-18T00:34:24.991748+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:24.991748+0000","last_undegraded":"2024-09-18T00:34:24.991748+0000","last_fullsized":"2024-09-18T00:34:24.991748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:38:44.367873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":306,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991859+0000","last_change":"2024-09-18T00:31:39.155377+0000","last_active":"2024-09-18T00:34:24.991859+0000","last_peered":"2024-09-18T00:34:24.991859+0000","last_clean":"2024-09-18T00:34:24.991859+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:24.991859+0000","last_undegraded":"2024-09-18T00:34:24.991859+0000","last_fullsized":"2024-09-18T00:34:24.991859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:55:41.639474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'1052","reported_seq":5279,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816126+0000","last_change":"2024-09-18T00:34:11.145910+0000","last_active":"2024-09-18T00:34:25.816126+0000","last_peered":"2024-09-18T00:34:25.816126+0000","last_clean":"2024-09-18T00:34:25.816126+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:25.816126+0000","last_undegraded":"2024-09-18T00:34:25.816126+0000","last_fullsized":"2024-09-18T00:34:25.816126+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:23.247998+0000","scrub_duration":0,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"145'644","reported_seq":3564,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992505+0000","last_change":"2024-09-18T00:33:58.848118+0000","last_active":"2024-09-18T00:34:24.992505+0000","last_peered":"2024-09-18T00:34:24.992505+0000","last_clean":"2024-09-18T00:34:24.992505+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:24.992505+0000","last_undegraded":"2024-09-18T00:34:24.992505+0000","last_fullsized":"2024-09-18T00:34:24.992505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:48.142039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":227,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816105+0000","last_change":"2024-09-18T00:34:10.900377+0000","last_active":"2024-09-18T00:34:25.816105+0000","last_peered":"2024-09-18T00:34:25.816105+0000","last_clean":"2024-09-18T00:34:25.816105+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:25.816105+0000","last_undegraded":"2024-09-18T00:34:25.816105+0000","last_fullsized":"2024-09-18T00:34:25.816105+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:34:16.361358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"143'429","reported_seq":2440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991742+0000","last_change":"2024-09-18T00:33:58.844266+0000","last_active":"2024-09-18T00:34:24.991742+0000","last_peered":"2024-09-18T00:34:24.991742+0000","last_clean":"2024-09-18T00:34:24.991742+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:24.991742+0000","last_undegraded":"2024-09-18T00:34:24.991742+0000","last_fullsized":"2024-09-18T00:34:24.991742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:00.303484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":156,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:33.821335+0000","last_change":"2024-09-18T00:34:33.821371+0000","last_active":"2024-09-18T00:34:33.821335+0000","last_peered":"2024-09-18T00:34:33.821335+0000","last_clean":"2024-09-18T00:34:33.821335+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:33.821335+0000","last_undegraded":"2024-09-18T00:34:33.821335+0000","last_fullsized":"2024-09-18T00:34:33.821335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:33.821228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:33.821228+0000","last_clean_scrub_stamp":"2024-09-18T00:34:33.821228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:18:46.928826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"144'620","reported_seq":9388,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475742+0000","last_change":"2024-09-18T00:34:11.899578+0000","last_active":"2024-09-18T00:34:25.475742+0000","last_peered":"2024-09-18T00:34:25.475742+0000","last_clean":"2024-09-18T00:34:25.475742+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:25.475742+0000","last_undegraded":"2024-09-18T00:34:25.475742+0000","last_fullsized":"2024-09-18T00:34:25.475742+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:25.964690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231895+0000","last_change":"2024-09-18T00:31:39.227579+0000","last_active":"2024-09-18T00:34:25.231895+0000","last_peered":"2024-09-18T00:34:25.231895+0000","last_clean":"2024-09-18T00:34:25.231895+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:25.231895+0000","last_undegraded":"2024-09-18T00:34:25.231895+0000","last_fullsized":"2024-09-18T00:34:25.231895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:37:00.966260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"150'526","reported_seq":5712,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817624+0000","last_change":"2024-09-18T00:34:10.982307+0000","last_active":"2024-09-18T00:34:25.817624+0000","last_peered":"2024-09-18T00:34:25.817624+0000","last_clean":"2024-09-18T00:34:25.817624+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:25.817624+0000","last_undegraded":"2024-09-18T00:34:25.817624+0000","last_fullsized":"2024-09-18T00:34:25.817624+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":226,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816106+0000","last_change":"2024-09-18T00:34:10.900639+0000","last_active":"2024-09-18T00:34:25.816106+0000","last_peered":"2024-09-18T00:34:25.816106+0000","last_clean":"2024-09-18T00:34:25.816106+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:25.816106+0000","last_undegraded":"2024-09-18T00:34:25.816106+0000","last_fullsized":"2024-09-18T00:34:25.816106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:36.120215+0000","last_clean_scrub_stamp":"2024-09-18T00:31:36.120215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:09:23.353390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":456,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232029+0000","last_change":"2024-09-18T00:31:30.098854+0000","last_active":"2024-09-18T00:34:25.232029+0000","last_peered":"2024-09-18T00:34:25.232029+0000","last_clean":"2024-09-18T00:34:25.232029+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:25.232029+0000","last_undegraded":"2024-09-18T00:34:25.232029+0000","last_fullsized":"2024-09-18T00:34:25.232029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:29.069471+0000","last_clean_scrub_stamp":"2024-09-18T00:31:29.069471+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:22:44.065073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"144'556","reported_seq":8025,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.817506+0000","last_change":"2024-09-18T00:33:58.915754+0000","last_active":"2024-09-18T00:34:25.817506+0000","last_peered":"2024-09-18T00:34:25.817506+0000","last_clean":"2024-09-18T00:34:25.817506+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:25.817506+0000","last_undegraded":"2024-09-18T00:34:25.817506+0000","last_fullsized":"2024-09-18T00:34:25.817506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"144'559","reported_seq":8539,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.992477+0000","last_change":"2024-09-18T00:33:58.847033+0000","last_active":"2024-09-18T00:34:24.992477+0000","last_peered":"2024-09-18T00:34:24.992477+0000","last_clean":"2024-09-18T00:34:24.992477+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:24.992477+0000","last_undegraded":"2024-09-18T00:34:24.992477+0000","last_fullsized":"2024-09-18T00:34:24.992477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:09:45.459931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"144'431","reported_seq":6440,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.370966+0000","last_change":"2024-09-18T00:33:58.841509+0000","last_active":"2024-09-18T00:34:25.370966+0000","last_peered":"2024-09-18T00:34:25.370966+0000","last_clean":"2024-09-18T00:34:25.370966+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:25.370966+0000","last_undegraded":"2024-09-18T00:34:25.370966+0000","last_fullsized":"2024-09-18T00:34:25.370966+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:13:31.149905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"143'703","reported_seq":5580,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816895+0000","last_change":"2024-09-18T00:33:58.914778+0000","last_active":"2024-09-18T00:34:25.816895+0000","last_peered":"2024-09-18T00:34:25.816895+0000","last_clean":"2024-09-18T00:34:25.816895+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:25.816895+0000","last_undegraded":"2024-09-18T00:34:25.816895+0000","last_fullsized":"2024-09-18T00:34:25.816895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"150'371","reported_seq":4927,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.816137+0000","last_change":"2024-09-18T00:34:11.173631+0000","last_active":"2024-09-18T00:34:25.816137+0000","last_peered":"2024-09-18T00:34:25.816137+0000","last_clean":"2024-09-18T00:34:25.816137+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:25.816137+0000","last_undegraded":"2024-09-18T00:34:25.816137+0000","last_fullsized":"2024-09-18T00:34:25.816137+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:32:12.847767+0000","scrub_duration":0,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"150'650","reported_seq":7010,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232084+0000","last_change":"2024-09-18T00:34:11.058471+0000","last_active":"2024-09-18T00:34:25.232084+0000","last_peered":"2024-09-18T00:34:25.232084+0000","last_clean":"2024-09-18T00:34:25.232084+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:25.232084+0000","last_undegraded":"2024-09-18T00:34:25.232084+0000","last_fullsized":"2024-09-18T00:34:25.232084+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:51:39.182028+0000","scrub_duration":0,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"144'773","reported_seq":11334,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232147+0000","last_change":"2024-09-18T00:33:58.856451+0000","last_active":"2024-09-18T00:34:25.232147+0000","last_peered":"2024-09-18T00:34:25.232147+0000","last_clean":"2024-09-18T00:34:25.232147+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:25.232147+0000","last_undegraded":"2024-09-18T00:34:25.232147+0000","last_fullsized":"2024-09-18T00:34:25.232147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:29:14.838716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"143'638","reported_seq":6380,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.232174+0000","last_change":"2024-09-18T00:33:58.856397+0000","last_active":"2024-09-18T00:34:25.232174+0000","last_peered":"2024-09-18T00:34:25.232174+0000","last_clean":"2024-09-18T00:34:25.232174+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:25.232174+0000","last_undegraded":"2024-09-18T00:34:25.232174+0000","last_fullsized":"2024-09-18T00:34:25.232174+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:21:14.859123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"143'600","reported_seq":5223,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:24.991638+0000","last_change":"2024-09-18T00:33:58.843666+0000","last_active":"2024-09-18T00:34:24.991638+0000","last_peered":"2024-09-18T00:34:24.991638+0000","last_clean":"2024-09-18T00:34:24.991638+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:24.991638+0000","last_undegraded":"2024-09-18T00:34:24.991638+0000","last_fullsized":"2024-09-18T00:34:24.991638+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:25.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"143'1369","reported_seq":6537,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231968+0000","last_change":"2024-09-18T00:33:58.855500+0000","last_active":"2024-09-18T00:34:25.231968+0000","last_peered":"2024-09-18T00:34:25.231968+0000","last_clean":"2024-09-18T00:34:25.231968+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:25.231968+0000","last_undegraded":"2024-09-18T00:34:25.231968+0000","last_fullsized":"2024-09-18T00:34:25.231968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:16.993051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"143'580","reported_seq":7338,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.475751+0000","last_change":"2024-09-18T00:34:11.900518+0000","last_active":"2024-09-18T00:34:25.475751+0000","last_peered":"2024-09-18T00:34:25.475751+0000","last_clean":"2024-09-18T00:34:25.475751+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:25.475751+0000","last_undegraded":"2024-09-18T00:34:25.475751+0000","last_fullsized":"2024-09-18T00:34:25.475751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:41:57.839332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"143'736","reported_seq":4221,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:25.231997+0000","last_change":"2024-09-18T00:33:58.854818+0000","last_active":"2024-09-18T00:34:25.231997+0000","last_peered":"2024-09-18T00:34:25.231997+0000","last_clean":"2024-09-18T00:34:25.231997+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:25.231997+0000","last_undegraded":"2024-09-18T00:34:25.231997+0000","last_fullsized":"2024-09-18T00:34:25.231997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:31:45.831505+0000","last_clean_scrub_stamp":"2024-09-18T00:31:45.831505+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:20.262640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20612,"ondisk_log_size":20612,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59532,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312308,"statfs":{"total":96636764160,"available":96575803392,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127111,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30684,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341156,"statfs":{"total":96636764160,"available":96605343744,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65056,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306784,"statfs":{"total":96636764160,"available":96570146816,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28964,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342876,"statfs":{"total":96636764160,"available":96607105024,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55324,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316516,"statfs":{"total":96636764160,"available":96580112384,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55372,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316468,"statfs":{"total":96636764160,"available":96580063232,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:36.030 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.030 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.030 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.030 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.030 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.030 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.031 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.032 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T00:31:36.120215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=36, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.033 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T00:31:29.069471+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=29, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.034 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.035 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.035 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.035 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T00:31:45.831505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=31, tm_sec=45, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=0, tm_min=34, tm_sec=31, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T00:34:36.035 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T00:34:56.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T00:34:56.326 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-18T00:34:56.326 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-18T00:34:56.340 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-18T00:34:55.074098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":248,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":240,"num_read":219138,"num_read_kb":1011897,"num_write":22837,"num_write_kb":487760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20980,"ondisk_log_size":20980,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369408,"kb_used_data":15488,"kb_used_omap":36,"kb_used_meta":353755,"kb_avail":754605312,"statfs":{"total":773094113280,"available":772715839488,"internally_reserved":0,"allocated":15859712,"data_stored":8762540,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":37874,"internal_metadata":362245134},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002667"},"pg_stats":[{"pgid":"3.1f","version":"164'547","reported_seq":6080,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:38.567299+0000","last_change":"2024-09-18T00:34:38.567372+0000","last_active":"2024-09-18T00:34:38.567299+0000","last_peered":"2024-09-18T00:34:38.567299+0000","last_clean":"2024-09-18T00:34:38.567299+0000","last_became_active":"2024-09-18T00:34:11.899488+0000","last_became_peered":"2024-09-18T00:34:11.899488+0000","last_unstale":"2024-09-18T00:34:38.567299+0000","last_undegraded":"2024-09-18T00:34:38.567299+0000","last_fullsized":"2024-09-18T00:34:38.567299+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'547","last_scrub_stamp":"2024-09-18T00:34:38.567205+0000","last_deep_scrub":"164'547","last_deep_scrub_stamp":"2024-09-18T00:34:38.567205+0000","last_clean_scrub_stamp":"2024-09-18T00:34:38.567205+0000","objects_scrubbed":7,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:45:04.233937+0000","scrub_duration":10,"objects_trimmed":22,"snaptrim_duration":0.030307935000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":8019,"num_read_kb":54774,"num_write":465,"num_write_kb":24367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'624","reported_seq":4311,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:35.350445+0000","last_change":"2024-09-18T00:34:35.350478+0000","last_active":"2024-09-18T00:34:35.350445+0000","last_peered":"2024-09-18T00:34:35.350445+0000","last_clean":"2024-09-18T00:34:35.350445+0000","last_became_active":"2024-09-18T00:31:46.852451+0000","last_became_peered":"2024-09-18T00:31:46.852451+0000","last_unstale":"2024-09-18T00:34:35.350445+0000","last_undegraded":"2024-09-18T00:34:35.350445+0000","last_fullsized":"2024-09-18T00:34:35.350445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'624","last_scrub_stamp":"2024-09-18T00:34:35.350372+0000","last_deep_scrub":"164'624","last_deep_scrub_stamp":"2024-09-18T00:34:35.350372+0000","last_clean_scrub_stamp":"2024-09-18T00:34:35.350372+0000","objects_scrubbed":5,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:44.695379+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.00062324899999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5426,"num_read_kb":45518,"num_write":868,"num_write_kb":24885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"164'631","reported_seq":6856,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:37.589068+0000","last_change":"2024-09-18T00:34:37.589110+0000","last_active":"2024-09-18T00:34:37.589068+0000","last_peered":"2024-09-18T00:34:37.589068+0000","last_clean":"2024-09-18T00:34:37.589068+0000","last_became_active":"2024-09-18T00:34:10.897288+0000","last_became_peered":"2024-09-18T00:34:10.897288+0000","last_unstale":"2024-09-18T00:34:37.589068+0000","last_undegraded":"2024-09-18T00:34:37.589068+0000","last_fullsized":"2024-09-18T00:34:37.589068+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'631","last_scrub_stamp":"2024-09-18T00:34:37.588980+0000","last_deep_scrub":"164'631","last_deep_scrub_stamp":"2024-09-18T00:34:37.588980+0000","last_clean_scrub_stamp":"2024-09-18T00:34:37.588980+0000","objects_scrubbed":9,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:59:58.161419+0000","scrub_duration":12,"objects_trimmed":20,"snaptrim_duration":0.061084017999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":7760,"num_read_kb":44748,"num_write":544,"num_write_kb":21559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"164'800","reported_seq":6614,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:39.600741+0000","last_change":"2024-09-18T00:34:39.600786+0000","last_active":"2024-09-18T00:34:39.600741+0000","last_peered":"2024-09-18T00:34:39.600741+0000","last_clean":"2024-09-18T00:34:39.600741+0000","last_became_active":"2024-09-18T00:34:10.899850+0000","last_became_peered":"2024-09-18T00:34:10.899850+0000","last_unstale":"2024-09-18T00:34:39.600741+0000","last_undegraded":"2024-09-18T00:34:39.600741+0000","last_fullsized":"2024-09-18T00:34:39.600741+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'800","last_scrub_stamp":"2024-09-18T00:34:39.600651+0000","last_deep_scrub":"164'800","last_deep_scrub_stamp":"2024-09-18T00:34:39.600651+0000","last_clean_scrub_stamp":"2024-09-18T00:34:39.600651+0000","objects_scrubbed":9,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:25:53.957656+0000","scrub_duration":8,"objects_trimmed":26,"snaptrim_duration":0.067564091000000007,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":7159,"num_read_kb":24026,"num_write":937,"num_write_kb":16076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'860","reported_seq":4088,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:34.619841+0000","last_change":"2024-09-18T00:34:34.619907+0000","last_active":"2024-09-18T00:34:34.619841+0000","last_peered":"2024-09-18T00:34:34.619841+0000","last_clean":"2024-09-18T00:34:34.619841+0000","last_became_active":"2024-09-18T00:34:11.897896+0000","last_became_peered":"2024-09-18T00:34:11.897896+0000","last_unstale":"2024-09-18T00:34:34.619841+0000","last_undegraded":"2024-09-18T00:34:34.619841+0000","last_fullsized":"2024-09-18T00:34:34.619841+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'860","last_scrub_stamp":"2024-09-18T00:34:34.619756+0000","last_deep_scrub":"164'860","last_deep_scrub_stamp":"2024-09-18T00:34:34.619756+0000","last_clean_scrub_stamp":"2024-09-18T00:34:34.619756+0000","objects_scrubbed":9,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:12:47.331027+0000","scrub_duration":9,"objects_trimmed":1,"snaptrim_duration":0.009580514,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5604,"num_read_kb":16065,"num_write":1238,"num_write_kb":7598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'439","reported_seq":10556,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:37.202703+0000","last_change":"2024-09-18T00:34:37.202767+0000","last_active":"2024-09-18T00:34:37.202703+0000","last_peered":"2024-09-18T00:34:37.202703+0000","last_clean":"2024-09-18T00:34:37.202703+0000","last_became_active":"2024-09-18T00:31:46.856755+0000","last_became_peered":"2024-09-18T00:31:46.856755+0000","last_unstale":"2024-09-18T00:34:37.202703+0000","last_undegraded":"2024-09-18T00:34:37.202703+0000","last_fullsized":"2024-09-18T00:34:37.202703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'439","last_scrub_stamp":"2024-09-18T00:34:37.202581+0000","last_deep_scrub":"164'439","last_deep_scrub_stamp":"2024-09-18T00:34:37.202581+0000","last_clean_scrub_stamp":"2024-09-18T00:34:37.202581+0000","objects_scrubbed":10,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:49:54.197621+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.0026369380000000001,"stat_sum":{"num_bytes":19,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":10044,"num_read_kb":52444,"num_write":418,"num_write_kb":47264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"164'739","reported_seq":2774,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:37.515018+0000","last_change":"2024-09-18T00:34:37.515054+0000","last_active":"2024-09-18T00:34:37.515018+0000","last_peered":"2024-09-18T00:34:37.515018+0000","last_clean":"2024-09-18T00:34:37.515018+0000","last_became_active":"2024-09-18T00:31:46.850435+0000","last_became_peered":"2024-09-18T00:31:46.850435+0000","last_unstale":"2024-09-18T00:34:37.515018+0000","last_undegraded":"2024-09-18T00:34:37.515018+0000","last_fullsized":"2024-09-18T00:34:37.515018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'739","last_scrub_stamp":"2024-09-18T00:34:37.514929+0000","last_deep_scrub":"164'739","last_deep_scrub_stamp":"2024-09-18T00:34:37.514929+0000","last_clean_scrub_stamp":"2024-09-18T00:34:37.514929+0000","objects_scrubbed":6,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:50:48.499468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00068163299999999996,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4138,"num_read_kb":23507,"num_write":1010,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"164'457","reported_seq":6070,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:37.395185+0000","last_change":"2024-09-18T00:34:37.395225+0000","last_active":"2024-09-18T00:34:37.395185+0000","last_peered":"2024-09-18T00:34:37.395185+0000","last_clean":"2024-09-18T00:34:37.395185+0000","last_became_active":"2024-09-18T00:31:46.857155+0000","last_became_peered":"2024-09-18T00:31:46.857155+0000","last_unstale":"2024-09-18T00:34:37.395185+0000","last_undegraded":"2024-09-18T00:34:37.395185+0000","last_fullsized":"2024-09-18T00:34:37.395185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'457","last_scrub_stamp":"2024-09-18T00:34:37.395084+0000","last_deep_scrub":"164'457","last_deep_scrub_stamp":"2024-09-18T00:34:37.395084+0000","last_clean_scrub_stamp":"2024-09-18T00:34:37.395084+0000","objects_scrubbed":6,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:43:33.987866+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0011550449999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":5958,"num_read_kb":30213,"num_write":417,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'1064","reported_seq":5247,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:37.526635+0000","last_change":"2024-09-18T00:34:37.526685+0000","last_active":"2024-09-18T00:34:37.526635+0000","last_peered":"2024-09-18T00:34:37.526635+0000","last_clean":"2024-09-18T00:34:37.526635+0000","last_became_active":"2024-09-18T00:34:11.899549+0000","last_became_peered":"2024-09-18T00:34:11.899549+0000","last_unstale":"2024-09-18T00:34:37.526635+0000","last_undegraded":"2024-09-18T00:34:37.526635+0000","last_fullsized":"2024-09-18T00:34:37.526635+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'1064","last_scrub_stamp":"2024-09-18T00:34:37.526547+0000","last_deep_scrub":"164'1064","last_deep_scrub_stamp":"2024-09-18T00:34:37.526547+0000","last_clean_scrub_stamp":"2024-09-18T00:34:37.526547+0000","objects_scrubbed":7,"log_size":1064,"log_dups_size":0,"ondisk_log_size":1064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:49:37.492835+0000","scrub_duration":10,"objects_trimmed":10,"snaptrim_duration":0.023747186999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9090,"num_read_kb":44513,"num_write":1522,"num_write_kb":16827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'693","reported_seq":3599,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:38.609180+0000","last_change":"2024-09-18T00:34:38.609254+0000","last_active":"2024-09-18T00:34:38.609180+0000","last_peered":"2024-09-18T00:34:38.609180+0000","last_clean":"2024-09-18T00:34:38.609180+0000","last_became_active":"2024-09-18T00:34:10.900218+0000","last_became_peered":"2024-09-18T00:34:10.900218+0000","last_unstale":"2024-09-18T00:34:38.609180+0000","last_undegraded":"2024-09-18T00:34:38.609180+0000","last_fullsized":"2024-09-18T00:34:38.609180+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'693","last_scrub_stamp":"2024-09-18T00:34:38.609077+0000","last_deep_scrub":"164'693","last_deep_scrub_stamp":"2024-09-18T00:34:38.609077+0000","last_clean_scrub_stamp":"2024-09-18T00:34:38.609077+0000","objects_scrubbed":12,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:38.332174+0000","scrub_duration":10,"objects_trimmed":8,"snaptrim_duration":0.030806813999999998,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":5428,"num_read_kb":14001,"num_write":759,"num_write_kb":6932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'628","reported_seq":5734,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:39.365210+0000","last_change":"2024-09-18T00:34:39.365253+0000","last_active":"2024-09-18T00:34:39.365210+0000","last_peered":"2024-09-18T00:34:39.365210+0000","last_clean":"2024-09-18T00:34:39.365210+0000","last_became_active":"2024-09-18T00:31:46.852468+0000","last_became_peered":"2024-09-18T00:31:46.852468+0000","last_unstale":"2024-09-18T00:34:39.365210+0000","last_undegraded":"2024-09-18T00:34:39.365210+0000","last_fullsized":"2024-09-18T00:34:39.365210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'628","last_scrub_stamp":"2024-09-18T00:34:39.365123+0000","last_deep_scrub":"164'628","last_deep_scrub_stamp":"2024-09-18T00:34:39.365123+0000","last_clean_scrub_stamp":"2024-09-18T00:34:39.365123+0000","objects_scrubbed":10,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:21:49.752121+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.0017175929999999999,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":6099,"num_read_kb":21075,"num_write":694,"num_write_kb":9160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"164'478","reported_seq":6488,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:35.158149+0000","last_change":"2024-09-18T00:34:35.158195+0000","last_active":"2024-09-18T00:34:35.158149+0000","last_peered":"2024-09-18T00:34:35.158149+0000","last_clean":"2024-09-18T00:34:35.158149+0000","last_became_active":"2024-09-18T00:31:46.854650+0000","last_became_peered":"2024-09-18T00:31:46.854650+0000","last_unstale":"2024-09-18T00:34:35.158149+0000","last_undegraded":"2024-09-18T00:34:35.158149+0000","last_fullsized":"2024-09-18T00:34:35.158149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'478","last_scrub_stamp":"2024-09-18T00:34:35.158050+0000","last_deep_scrub":"164'478","last_deep_scrub_stamp":"2024-09-18T00:34:35.158050+0000","last_clean_scrub_stamp":"2024-09-18T00:34:35.158050+0000","objects_scrubbed":7,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:25:13.161955+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0.001791642,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6043,"num_read_kb":34583,"num_write":483,"num_write_kb":18988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:35.500853+0000","last_change":"2024-09-18T00:34:35.500889+0000","last_active":"2024-09-18T00:34:35.500853+0000","last_peered":"2024-09-18T00:34:35.500853+0000","last_clean":"2024-09-18T00:34:35.500853+0000","last_became_active":"2024-09-18T00:33:22.779089+0000","last_became_peered":"2024-09-18T00:33:22.779089+0000","last_unstale":"2024-09-18T00:34:35.500853+0000","last_undegraded":"2024-09-18T00:34:35.500853+0000","last_fullsized":"2024-09-18T00:34:35.500853+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:35.500761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:35.500761+0000","last_clean_scrub_stamp":"2024-09-18T00:34:35.500761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:27:21.282622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"164'372","reported_seq":2504,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:33.574619+0000","last_change":"2024-09-18T00:34:33.574648+0000","last_active":"2024-09-18T00:34:33.574619+0000","last_peered":"2024-09-18T00:34:33.574619+0000","last_clean":"2024-09-18T00:34:33.574619+0000","last_became_active":"2024-09-18T00:31:46.856593+0000","last_became_peered":"2024-09-18T00:31:46.856593+0000","last_unstale":"2024-09-18T00:34:33.574619+0000","last_undegraded":"2024-09-18T00:34:33.574619+0000","last_fullsized":"2024-09-18T00:34:33.574619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'372","last_scrub_stamp":"2024-09-18T00:34:33.574549+0000","last_deep_scrub":"164'372","last_deep_scrub_stamp":"2024-09-18T00:34:33.574549+0000","last_clean_scrub_stamp":"2024-09-18T00:34:33.574549+0000","objects_scrubbed":5,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:44:33.293693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0011474269999999999,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":1816,"num_read_kb":13696,"num_write":295,"num_write_kb":9715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":315,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:33.510549+0000","last_change":"2024-09-18T00:34:33.510568+0000","last_active":"2024-09-18T00:34:33.510549+0000","last_peered":"2024-09-18T00:34:33.510549+0000","last_clean":"2024-09-18T00:34:33.510549+0000","last_became_active":"2024-09-18T00:31:37.149274+0000","last_became_peered":"2024-09-18T00:31:37.149274+0000","last_unstale":"2024-09-18T00:34:33.510549+0000","last_undegraded":"2024-09-18T00:34:33.510549+0000","last_fullsized":"2024-09-18T00:34:33.510549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:33.510468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:33.510468+0000","last_clean_scrub_stamp":"2024-09-18T00:34:33.510468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:19:07.129832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"164'550","reported_seq":3833,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:34.327748+0000","last_change":"2024-09-18T00:34:34.327807+0000","last_active":"2024-09-18T00:34:34.327748+0000","last_peered":"2024-09-18T00:34:34.327748+0000","last_clean":"2024-09-18T00:34:34.327748+0000","last_became_active":"2024-09-18T00:31:46.851446+0000","last_became_peered":"2024-09-18T00:31:46.851446+0000","last_unstale":"2024-09-18T00:34:34.327748+0000","last_undegraded":"2024-09-18T00:34:34.327748+0000","last_fullsized":"2024-09-18T00:34:34.327748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'550","last_scrub_stamp":"2024-09-18T00:34:34.327659+0000","last_deep_scrub":"164'550","last_deep_scrub_stamp":"2024-09-18T00:34:34.327659+0000","last_clean_scrub_stamp":"2024-09-18T00:34:34.327659+0000","objects_scrubbed":9,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:22.821981+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.00085604699999999997,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":3832,"num_read_kb":10060,"num_write":612,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:38.383673+0000","last_change":"2024-09-18T00:34:38.383697+0000","last_active":"2024-09-18T00:34:38.383673+0000","last_peered":"2024-09-18T00:34:38.383673+0000","last_clean":"2024-09-18T00:34:38.383673+0000","last_became_active":"2024-09-18T00:31:37.173624+0000","last_became_peered":"2024-09-18T00:31:37.173624+0000","last_unstale":"2024-09-18T00:34:38.383673+0000","last_undegraded":"2024-09-18T00:34:38.383673+0000","last_fullsized":"2024-09-18T00:34:38.383673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:38.383575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:38.383575+0000","last_clean_scrub_stamp":"2024-09-18T00:34:38.383575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:49:27.528315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037458400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'609","reported_seq":4140,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:35.526061+0000","last_change":"2024-09-18T00:34:35.526091+0000","last_active":"2024-09-18T00:34:35.526061+0000","last_peered":"2024-09-18T00:34:35.526061+0000","last_clean":"2024-09-18T00:34:35.526061+0000","last_became_active":"2024-09-18T00:31:46.847285+0000","last_became_peered":"2024-09-18T00:31:46.847285+0000","last_unstale":"2024-09-18T00:34:35.526061+0000","last_undegraded":"2024-09-18T00:34:35.526061+0000","last_fullsized":"2024-09-18T00:34:35.526061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'609","last_scrub_stamp":"2024-09-18T00:34:35.525990+0000","last_deep_scrub":"164'609","last_deep_scrub_stamp":"2024-09-18T00:34:35.525990+0000","last_clean_scrub_stamp":"2024-09-18T00:34:35.525990+0000","objects_scrubbed":5,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:03:34.593084+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.00093238999999999995,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":4318,"num_read_kb":10649,"num_write":536,"num_write_kb":6879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":315,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:34.499811+0000","last_change":"2024-09-18T00:34:34.499856+0000","last_active":"2024-09-18T00:34:34.499811+0000","last_peered":"2024-09-18T00:34:34.499811+0000","last_clean":"2024-09-18T00:34:34.499811+0000","last_became_active":"2024-09-18T00:31:37.173388+0000","last_became_peered":"2024-09-18T00:31:37.173388+0000","last_unstale":"2024-09-18T00:34:34.499811+0000","last_undegraded":"2024-09-18T00:34:34.499811+0000","last_fullsized":"2024-09-18T00:34:34.499811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:34.499718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:34.499718+0000","last_clean_scrub_stamp":"2024-09-18T00:34:34.499718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:08.105326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054416899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"164'1063","reported_seq":5299,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:40.641864+0000","last_change":"2024-09-18T00:34:40.641920+0000","last_active":"2024-09-18T00:34:40.641864+0000","last_peered":"2024-09-18T00:34:40.641864+0000","last_clean":"2024-09-18T00:34:40.641864+0000","last_became_active":"2024-09-18T00:34:10.902529+0000","last_became_peered":"2024-09-18T00:34:10.902529+0000","last_unstale":"2024-09-18T00:34:40.641864+0000","last_undegraded":"2024-09-18T00:34:40.641864+0000","last_fullsized":"2024-09-18T00:34:40.641864+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'1063","last_scrub_stamp":"2024-09-18T00:34:40.641775+0000","last_deep_scrub":"164'1063","last_deep_scrub_stamp":"2024-09-18T00:34:40.641775+0000","last_clean_scrub_stamp":"2024-09-18T00:34:40.641775+0000","objects_scrubbed":11,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:00.332084+0000","scrub_duration":9,"objects_trimmed":16,"snaptrim_duration":0.053910663999999997,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7638,"num_read_kb":18739,"num_write":1342,"num_write_kb":5707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"164'654","reported_seq":3583,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:38.225047+0000","last_change":"2024-09-18T00:34:38.225091+0000","last_active":"2024-09-18T00:34:38.225047+0000","last_peered":"2024-09-18T00:34:38.225047+0000","last_clean":"2024-09-18T00:34:38.225047+0000","last_became_active":"2024-09-18T00:31:46.857812+0000","last_became_peered":"2024-09-18T00:31:46.857812+0000","last_unstale":"2024-09-18T00:34:38.225047+0000","last_undegraded":"2024-09-18T00:34:38.225047+0000","last_fullsized":"2024-09-18T00:34:38.225047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'654","last_scrub_stamp":"2024-09-18T00:34:38.224958+0000","last_deep_scrub":"164'654","last_deep_scrub_stamp":"2024-09-18T00:34:38.224958+0000","last_clean_scrub_stamp":"2024-09-18T00:34:38.224958+0000","objects_scrubbed":10,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:22.775149+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.0032462680000000001,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":9,"num_read":3476,"num_read_kb":17095,"num_write":574,"num_write_kb":6298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"164'3","reported_seq":237,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:35.568123+0000","last_change":"2024-09-18T00:34:35.568180+0000","last_active":"2024-09-18T00:34:35.568123+0000","last_peered":"2024-09-18T00:34:35.568123+0000","last_clean":"2024-09-18T00:34:35.568123+0000","last_became_active":"2024-09-18T00:34:10.899936+0000","last_became_peered":"2024-09-18T00:34:10.899936+0000","last_unstale":"2024-09-18T00:34:35.568123+0000","last_undegraded":"2024-09-18T00:34:35.568123+0000","last_fullsized":"2024-09-18T00:34:35.568123+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'3","last_scrub_stamp":"2024-09-18T00:34:35.568011+0000","last_deep_scrub":"164'3","last_deep_scrub_stamp":"2024-09-18T00:34:35.568011+0000","last_clean_scrub_stamp":"2024-09-18T00:34:35.568011+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:11:51.284618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'435","reported_seq":2455,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.503612+0000","last_change":"2024-09-18T00:34:36.503638+0000","last_active":"2024-09-18T00:34:36.503612+0000","last_peered":"2024-09-18T00:34:36.503612+0000","last_clean":"2024-09-18T00:34:36.503612+0000","last_became_active":"2024-09-18T00:31:46.847341+0000","last_became_peered":"2024-09-18T00:31:46.847341+0000","last_unstale":"2024-09-18T00:34:36.503612+0000","last_undegraded":"2024-09-18T00:34:36.503612+0000","last_fullsized":"2024-09-18T00:34:36.503612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'435","last_scrub_stamp":"2024-09-18T00:34:36.503542+0000","last_deep_scrub":"164'435","last_deep_scrub_stamp":"2024-09-18T00:34:36.503542+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.503542+0000","objects_scrubbed":6,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:36:56.195051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011676880000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":1614,"num_read_kb":13621,"num_write":326,"num_write_kb":14628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":156,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:33.821335+0000","last_change":"2024-09-18T00:34:33.821371+0000","last_active":"2024-09-18T00:34:33.821335+0000","last_peered":"2024-09-18T00:34:33.821335+0000","last_clean":"2024-09-18T00:34:33.821335+0000","last_became_active":"2024-09-18T00:34:16.067206+0000","last_became_peered":"2024-09-18T00:34:16.067206+0000","last_unstale":"2024-09-18T00:34:33.821335+0000","last_undegraded":"2024-09-18T00:34:33.821335+0000","last_fullsized":"2024-09-18T00:34:33.821335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:33.821228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:33.821228+0000","last_clean_scrub_stamp":"2024-09-18T00:34:33.821228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:18:46.928826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'628","reported_seq":9405,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:35.583215+0000","last_change":"2024-09-18T00:34:35.583264+0000","last_active":"2024-09-18T00:34:35.583215+0000","last_peered":"2024-09-18T00:34:35.583215+0000","last_clean":"2024-09-18T00:34:35.583215+0000","last_became_active":"2024-09-18T00:34:11.897678+0000","last_became_peered":"2024-09-18T00:34:11.897678+0000","last_unstale":"2024-09-18T00:34:35.583215+0000","last_undegraded":"2024-09-18T00:34:35.583215+0000","last_fullsized":"2024-09-18T00:34:35.583215+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'628","last_scrub_stamp":"2024-09-18T00:34:35.583121+0000","last_deep_scrub":"164'628","last_deep_scrub_stamp":"2024-09-18T00:34:35.583121+0000","last_clean_scrub_stamp":"2024-09-18T00:34:35.583121+0000","objects_scrubbed":8,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:53.537192+0000","scrub_duration":7,"objects_trimmed":2,"snaptrim_duration":0.001062283,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":9797,"num_read_kb":60800,"num_write":642,"num_write_kb":19314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":314,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:37.352679+0000","last_change":"2024-09-18T00:34:37.352700+0000","last_active":"2024-09-18T00:34:37.352679+0000","last_peered":"2024-09-18T00:34:37.352679+0000","last_clean":"2024-09-18T00:34:37.352679+0000","last_became_active":"2024-09-18T00:31:37.146378+0000","last_became_peered":"2024-09-18T00:31:37.146378+0000","last_unstale":"2024-09-18T00:34:37.352679+0000","last_undegraded":"2024-09-18T00:34:37.352679+0000","last_fullsized":"2024-09-18T00:34:37.352679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T00:34:37.352588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T00:34:37.352588+0000","last_clean_scrub_stamp":"2024-09-18T00:34:37.352588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:04:09.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000418794,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'533","reported_seq":5727,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:39.335033+0000","last_change":"2024-09-18T00:34:39.335079+0000","last_active":"2024-09-18T00:34:39.335033+0000","last_peered":"2024-09-18T00:34:39.335033+0000","last_clean":"2024-09-18T00:34:39.335033+0000","last_became_active":"2024-09-18T00:34:10.901929+0000","last_became_peered":"2024-09-18T00:34:10.901929+0000","last_unstale":"2024-09-18T00:34:39.335033+0000","last_undegraded":"2024-09-18T00:34:39.335033+0000","last_fullsized":"2024-09-18T00:34:39.335033+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'533","last_scrub_stamp":"2024-09-18T00:34:39.334937+0000","last_deep_scrub":"164'533","last_deep_scrub_stamp":"2024-09-18T00:34:39.334937+0000","last_clean_scrub_stamp":"2024-09-18T00:34:39.334937+0000","objects_scrubbed":7,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:15.207371+0000","scrub_duration":6,"objects_trimmed":24,"snaptrim_duration":0.057959162000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":5795,"num_read_kb":33111,"num_write":488,"num_write_kb":23262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"164'2","reported_seq":236,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.608204+0000","last_change":"2024-09-18T00:34:36.608236+0000","last_active":"2024-09-18T00:34:36.608204+0000","last_peered":"2024-09-18T00:34:36.608204+0000","last_clean":"2024-09-18T00:34:36.608204+0000","last_became_active":"2024-09-18T00:34:10.899841+0000","last_became_peered":"2024-09-18T00:34:10.899841+0000","last_unstale":"2024-09-18T00:34:36.608204+0000","last_undegraded":"2024-09-18T00:34:36.608204+0000","last_fullsized":"2024-09-18T00:34:36.608204+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'2","last_scrub_stamp":"2024-09-18T00:34:36.608122+0000","last_deep_scrub":"164'2","last_deep_scrub_stamp":"2024-09-18T00:34:36.608122+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.608122+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:06:05.097271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"164'119","reported_seq":467,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.342086+0000","last_change":"2024-09-18T00:34:36.342128+0000","last_active":"2024-09-18T00:34:36.342086+0000","last_peered":"2024-09-18T00:34:36.342086+0000","last_clean":"2024-09-18T00:34:36.342086+0000","last_became_active":"2024-09-18T00:31:30.097697+0000","last_became_peered":"2024-09-18T00:31:30.097697+0000","last_unstale":"2024-09-18T00:34:36.342086+0000","last_undegraded":"2024-09-18T00:34:36.342086+0000","last_fullsized":"2024-09-18T00:34:36.342086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'119","last_scrub_stamp":"2024-09-18T00:34:36.341987+0000","last_deep_scrub":"164'119","last_deep_scrub_stamp":"2024-09-18T00:34:36.341987+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.341987+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:55:31.476363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"164'562","reported_seq":8039,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.385890+0000","last_change":"2024-09-18T00:34:36.385945+0000","last_active":"2024-09-18T00:34:36.385890+0000","last_peered":"2024-09-18T00:34:36.385890+0000","last_clean":"2024-09-18T00:34:36.385890+0000","last_became_active":"2024-09-18T00:31:46.855917+0000","last_became_peered":"2024-09-18T00:31:46.855917+0000","last_unstale":"2024-09-18T00:34:36.385890+0000","last_undegraded":"2024-09-18T00:34:36.385890+0000","last_fullsized":"2024-09-18T00:34:36.385890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'562","last_scrub_stamp":"2024-09-18T00:34:36.385782+0000","last_deep_scrub":"164'562","last_deep_scrub_stamp":"2024-09-18T00:34:36.385782+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.385782+0000","objects_scrubbed":6,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:15.463201+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.001096404,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":10582,"num_read_kb":46363,"num_write":491,"num_write_kb":12167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'566","reported_seq":8555,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.196408+0000","last_change":"2024-09-18T00:34:36.196446+0000","last_active":"2024-09-18T00:34:36.196408+0000","last_peered":"2024-09-18T00:34:36.196408+0000","last_clean":"2024-09-18T00:34:36.196408+0000","last_became_active":"2024-09-18T00:31:46.856288+0000","last_became_peered":"2024-09-18T00:31:46.856288+0000","last_unstale":"2024-09-18T00:34:36.196408+0000","last_undegraded":"2024-09-18T00:34:36.196408+0000","last_fullsized":"2024-09-18T00:34:36.196408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'566","last_scrub_stamp":"2024-09-18T00:34:36.196323+0000","last_deep_scrub":"164'566","last_deep_scrub_stamp":"2024-09-18T00:34:36.196323+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.196323+0000","objects_scrubbed":7,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:48.675330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0024391640000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9460,"num_read_kb":40850,"num_write":571,"num_write_kb":7965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'440","reported_seq":6458,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.483160+0000","last_change":"2024-09-18T00:34:36.483208+0000","last_active":"2024-09-18T00:34:36.483160+0000","last_peered":"2024-09-18T00:34:36.483160+0000","last_clean":"2024-09-18T00:34:36.483160+0000","last_became_active":"2024-09-18T00:33:22.778526+0000","last_became_peered":"2024-09-18T00:33:22.778526+0000","last_unstale":"2024-09-18T00:34:36.483160+0000","last_undegraded":"2024-09-18T00:34:36.483160+0000","last_fullsized":"2024-09-18T00:34:36.483160+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'440","last_scrub_stamp":"2024-09-18T00:34:36.483068+0000","last_deep_scrub":"164'440","last_deep_scrub_stamp":"2024-09-18T00:34:36.483068+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.483068+0000","objects_scrubbed":9,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:07:26.686871+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00034723300000000001,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":6234,"num_read_kb":20500,"num_write":356,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'714","reported_seq":5599,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:38.380659+0000","last_change":"2024-09-18T00:34:38.380705+0000","last_active":"2024-09-18T00:34:38.380659+0000","last_peered":"2024-09-18T00:34:38.380659+0000","last_clean":"2024-09-18T00:34:38.380659+0000","last_became_active":"2024-09-18T00:31:46.857094+0000","last_became_peered":"2024-09-18T00:31:46.857094+0000","last_unstale":"2024-09-18T00:34:38.380659+0000","last_undegraded":"2024-09-18T00:34:38.380659+0000","last_fullsized":"2024-09-18T00:34:38.380659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'714","last_scrub_stamp":"2024-09-18T00:34:38.380560+0000","last_deep_scrub":"164'714","last_deep_scrub_stamp":"2024-09-18T00:34:38.380560+0000","last_clean_scrub_stamp":"2024-09-18T00:34:38.380560+0000","objects_scrubbed":11,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:54:45.845008+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.000604197,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":8164,"num_read_kb":38098,"num_write":642,"num_write_kb":21354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'380","reported_seq":4945,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:41.669159+0000","last_change":"2024-09-18T00:34:41.669230+0000","last_active":"2024-09-18T00:34:41.669159+0000","last_peered":"2024-09-18T00:34:41.669159+0000","last_clean":"2024-09-18T00:34:41.669159+0000","last_became_active":"2024-09-18T00:34:10.904293+0000","last_became_peered":"2024-09-18T00:34:10.904293+0000","last_unstale":"2024-09-18T00:34:41.669159+0000","last_undegraded":"2024-09-18T00:34:41.669159+0000","last_fullsized":"2024-09-18T00:34:41.669159+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'380","last_scrub_stamp":"2024-09-18T00:34:41.669044+0000","last_deep_scrub":"164'380","last_deep_scrub_stamp":"2024-09-18T00:34:41.669044+0000","last_clean_scrub_stamp":"2024-09-18T00:34:41.669044+0000","objects_scrubbed":9,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:22:05.942007+0000","scrub_duration":7,"objects_trimmed":14,"snaptrim_duration":0.037964069000000003,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":4246,"num_read_kb":24869,"num_write":347,"num_write_kb":16264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'658","reported_seq":7027,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:44.425829+0000","last_change":"2024-09-18T00:34:44.425908+0000","last_active":"2024-09-18T00:34:44.425829+0000","last_peered":"2024-09-18T00:34:44.425829+0000","last_clean":"2024-09-18T00:34:44.425829+0000","last_became_active":"2024-09-18T00:34:10.907752+0000","last_became_peered":"2024-09-18T00:34:10.907752+0000","last_unstale":"2024-09-18T00:34:44.425829+0000","last_undegraded":"2024-09-18T00:34:44.425829+0000","last_fullsized":"2024-09-18T00:34:44.425829+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'658","last_scrub_stamp":"2024-09-18T00:34:44.425733+0000","last_deep_scrub":"164'658","last_deep_scrub_stamp":"2024-09-18T00:34:44.425733+0000","last_clean_scrub_stamp":"2024-09-18T00:34:44.425733+0000","objects_scrubbed":8,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:00:07.992061+0000","scrub_duration":8,"objects_trimmed":28,"snaptrim_duration":0.063606365999999998,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":8,"num_read":8454,"num_read_kb":22953,"num_write":582,"num_write_kb":6738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'777","reported_seq":11347,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:40.391916+0000","last_change":"2024-09-18T00:34:40.391955+0000","last_active":"2024-09-18T00:34:40.391916+0000","last_peered":"2024-09-18T00:34:40.391916+0000","last_clean":"2024-09-18T00:34:40.391916+0000","last_became_active":"2024-09-18T00:31:46.858049+0000","last_became_peered":"2024-09-18T00:31:46.858049+0000","last_unstale":"2024-09-18T00:34:40.391916+0000","last_undegraded":"2024-09-18T00:34:40.391916+0000","last_fullsized":"2024-09-18T00:34:40.391916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'777","last_scrub_stamp":"2024-09-18T00:34:40.391818+0000","last_deep_scrub":"164'777","last_deep_scrub_stamp":"2024-09-18T00:34:40.391818+0000","last_clean_scrub_stamp":"2024-09-18T00:34:40.391818+0000","objects_scrubbed":4,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:56:26.826196+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0021586090000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":12974,"num_read_kb":39252,"num_write":834,"num_write_kb":10470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'649","reported_seq":6400,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:43.377282+0000","last_change":"2024-09-18T00:34:43.377339+0000","last_active":"2024-09-18T00:34:43.377282+0000","last_peered":"2024-09-18T00:34:43.377282+0000","last_clean":"2024-09-18T00:34:43.377282+0000","last_became_active":"2024-09-18T00:33:25.829940+0000","last_became_peered":"2024-09-18T00:33:25.829940+0000","last_unstale":"2024-09-18T00:34:43.377282+0000","last_undegraded":"2024-09-18T00:34:43.377282+0000","last_fullsized":"2024-09-18T00:34:43.377282+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'649","last_scrub_stamp":"2024-09-18T00:34:43.377192+0000","last_deep_scrub":"164'649","last_deep_scrub_stamp":"2024-09-18T00:34:43.377192+0000","last_clean_scrub_stamp":"2024-09-18T00:34:43.377192+0000","objects_scrubbed":11,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:33:58.499840+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0.0021792600000000001,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":11,"num_read":7824,"num_read_kb":29700,"num_write":633,"num_write_kb":10874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":5493718,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'604","reported_seq":5236,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:38.507184+0000","last_change":"2024-09-18T00:34:38.507222+0000","last_active":"2024-09-18T00:34:38.507184+0000","last_peered":"2024-09-18T00:34:38.507184+0000","last_clean":"2024-09-18T00:34:38.507184+0000","last_became_active":"2024-09-18T00:33:19.806159+0000","last_became_peered":"2024-09-18T00:33:19.806159+0000","last_unstale":"2024-09-18T00:34:38.507184+0000","last_undegraded":"2024-09-18T00:34:38.507184+0000","last_fullsized":"2024-09-18T00:34:38.507184+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'604","last_scrub_stamp":"2024-09-18T00:34:38.507097+0000","last_deep_scrub":"164'604","last_deep_scrub_stamp":"2024-09-18T00:34:38.507097+0000","last_clean_scrub_stamp":"2024-09-18T00:34:38.507097+0000","objects_scrubbed":4,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:01:53.902209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00064465900000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5606,"num_read_kb":35998,"num_write":751,"num_write_kb":24004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":13603880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'1375","reported_seq":6552,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:42.405795+0000","last_change":"2024-09-18T00:34:42.405836+0000","last_active":"2024-09-18T00:34:42.405795+0000","last_peered":"2024-09-18T00:34:42.405795+0000","last_clean":"2024-09-18T00:34:42.405795+0000","last_became_active":"2024-09-18T00:32:01.923245+0000","last_became_peered":"2024-09-18T00:32:01.923245+0000","last_unstale":"2024-09-18T00:34:42.405795+0000","last_undegraded":"2024-09-18T00:34:42.405795+0000","last_fullsized":"2024-09-18T00:34:42.405795+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'1375","last_scrub_stamp":"2024-09-18T00:34:42.405702+0000","last_deep_scrub":"164'1375","last_deep_scrub_stamp":"2024-09-18T00:34:42.405702+0000","last_clean_scrub_stamp":"2024-09-18T00:34:42.405702+0000","objects_scrubbed":6,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:29:12.785205+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.0016724159999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":13501,"num_read_kb":32212,"num_write":1882,"num_write_kb":11160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'586","reported_seq":7353,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:36.544059+0000","last_change":"2024-09-18T00:34:36.544087+0000","last_active":"2024-09-18T00:34:36.544059+0000","last_peered":"2024-09-18T00:34:36.544059+0000","last_clean":"2024-09-18T00:34:36.544059+0000","last_became_active":"2024-09-18T00:34:11.898966+0000","last_became_peered":"2024-09-18T00:34:11.898966+0000","last_unstale":"2024-09-18T00:34:36.544059+0000","last_undegraded":"2024-09-18T00:34:36.544059+0000","last_fullsized":"2024-09-18T00:34:36.544059+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'586","last_scrub_stamp":"2024-09-18T00:34:36.543979+0000","last_deep_scrub":"164'586","last_deep_scrub_stamp":"2024-09-18T00:34:36.543979+0000","last_clean_scrub_stamp":"2024-09-18T00:34:36.543979+0000","objects_scrubbed":6,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:19:04.912673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.001035956,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":7827,"num_read_kb":71616,"num_write":526,"num_write_kb":29015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'741","reported_seq":4235,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-18T00:34:41.404246+0000","last_change":"2024-09-18T00:34:41.404300+0000","last_active":"2024-09-18T00:34:41.404246+0000","last_peered":"2024-09-18T00:34:41.404246+0000","last_clean":"2024-09-18T00:34:41.404246+0000","last_became_active":"2024-09-18T00:31:46.858000+0000","last_became_peered":"2024-09-18T00:31:46.858000+0000","last_unstale":"2024-09-18T00:34:41.404246+0000","last_undegraded":"2024-09-18T00:34:41.404246+0000","last_fullsized":"2024-09-18T00:34:41.404246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'741","last_scrub_stamp":"2024-09-18T00:34:41.404100+0000","last_deep_scrub":"164'741","last_deep_scrub_stamp":"2024-09-18T00:34:41.404100+0000","last_clean_scrub_stamp":"2024-09-18T00:34:41.404100+0000","objects_scrubbed":5,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:53:38.580212+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.00098207299999999997,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5096,"num_read_kb":26148,"num_write":891,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":244,"num_object_clones":0,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":240,"num_read":219022,"num_read_kb":1011797,"num_write":22676,"num_write_kb":485342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":19097598,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},"log_size":20856,"ondisk_log_size":20856,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":9882,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59528,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312312,"statfs":{"total":96636764160,"available":96575807488,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":149,"seq":639950127115,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30676,"kb_used_data":1924,"kb_used_omap":26,"kb_used_meta":28709,"kb_avail":94341164,"statfs":{"total":96636764160,"available":96605351936,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26717,"internal_metadata":29398947},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65044,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306796,"statfs":{"total":96636764160,"available":96570159104,"internally_reserved":0,"allocated":1970176,"data_stored":947735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28952,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342888,"statfs":{"total":96636764160,"available":96607117312,"internally_reserved":0,"allocated":1974272,"data_stored":947754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55312,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316528,"statfs":{"total":96636764160,"available":96580124672,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":1966080,"data_stored":947716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55368,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316472,"statfs":{"total":96636764160,"available":96580067328,"internally_reserved":0,"allocated":2023424,"data_stored":1538084,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":4941,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1175,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9489,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T00:34:56.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T00:34:56.637 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T00:34:56.638 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T00:34:56.638 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T00:34:56.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:56.681 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T00:34:56.681 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T00:34:56.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:56.712 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T00:34:56.713 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T00:34:56.713 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:56.780 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T00:34:56.781 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T00:34:56.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:56.849 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T00:34:56.850 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-18T00:34:56.850 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:56.888 INFO:tasks.ceph.osd.4:Stopped 2024-09-18T00:34:56.888 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-18T00:34:56.889 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:56.958 INFO:tasks.ceph.osd.5:Stopped 2024-09-18T00:34:56.959 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-18T00:34:56.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.034 INFO:tasks.ceph.osd.6:Stopped 2024-09-18T00:34:57.034 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-18T00:34:57.034 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.115 INFO:tasks.ceph.osd.7:Stopped 2024-09-18T00:34:57.115 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T00:34:57.116 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-18T00:34:57.116 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.142 INFO:tasks.ceph.mgr.y:Stopped 2024-09-18T00:34:57.142 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T00:34:57.142 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.184 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T00:34:57.185 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T00:34:57.185 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T00:34:57.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.196 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T00:34:57.197 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-18T00:34:57.197 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.248 INFO:tasks.ceph.mon.c:Stopped 2024-09-18T00:34:57.248 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-18T00:34:57.248 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T00:34:57.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-18T00:34:57.262 INFO:tasks.ceph.mon.b:Stopped 2024-09-18T00:34:57.263 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T00:34:57.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-18T00:34:57.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:34:57.325 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T00:34:57.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:34:57.512 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T00:34:57.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:34:57.586 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T00:34:57.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:34:57.642 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T00:34:57.694 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:34:57.694 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-18T00:34:57.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:34:57.878 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-18T00:34:57.990 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:34:57.990 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-18T00:34:58.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:34:58.048 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-18T00:34:58.105 INFO:tasks.ceph:Archiving mon data... 2024-09-18T00:34:58.106 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/data/mon.a.tgz 2024-09-18T00:34:58.106 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-18T00:34:58.123 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.agwpacvsDB 2024-09-18T00:34:58.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.agwpacvsDB 2024-09-18T00:34:58.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.agwpacvsDB 2024-09-18T00:34:58.364 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.agwpacvsDB is 394KB 2024-09-18T00:34:58.461 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.agwpacvsDB 2024-09-18T00:34:58.476 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/data/mon.c.tgz 2024-09-18T00:34:58.476 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-18T00:34:58.531 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.QHlf3Kr8xq 2024-09-18T00:34:58.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QHlf3Kr8xq 2024-09-18T00:34:58.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.QHlf3Kr8xq 2024-09-18T00:34:58.787 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.QHlf3Kr8xq is 535KB 2024-09-18T00:34:58.885 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.QHlf3Kr8xq 2024-09-18T00:34:58.900 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/data/mon.b.tgz 2024-09-18T00:34:58.900 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-18T00:34:58.919 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.uGLbA07Mko 2024-09-18T00:34:58.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uGLbA07Mko 2024-09-18T00:34:59.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.uGLbA07Mko 2024-09-18T00:34:59.197 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.uGLbA07Mko is 535KB 2024-09-18T00:34:59.269 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.uGLbA07Mko 2024-09-18T00:34:59.284 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T00:34:59.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T00:34:59.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T00:34:59.365 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T00:34:59.404 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T00:34:59.404 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T00:34:59.406 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/remote/smithi081/crash 2024-09-18T00:34:59.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T00:34:59.431 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/remote/smithi167/crash 2024-09-18T00:34:59.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T00:34:59.468 INFO:tasks.ceph:Compressing logs... 2024-09-18T00:34:59.468 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T00:34:59.476 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.47028.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/objectstore_tool.47028.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.45248.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/objectstore_tool.45248.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.46188.log 2024-09-18T00:34:59.543 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44446.log 2024-09-18T00:34:59.544 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/objectstore_tool.46188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/objectstore_tool.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33062.log 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33062.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33062.log.gz 2024-09-18T00:34:59.545 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T00:34:59.553 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.5.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.47028.log.gz 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33191.log 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr: 95.2% -- replaced with /var/log/ceph/objectstore_tool.45248.log.gz 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.log: 95.1% -- replaced with /var/log/ceph/objectstore_tool.46188.log.gz 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.44446.log.gz 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33191.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mon.b.log 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33191.log.gz 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33111.log 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33231.log 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33151.log 2024-09-18T00:34:59.554 INFO:teuthology.orchestra.run.smithi167.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33111.log.gz 2024-09-18T00:34:59.555 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33231.log.gz 2024-09-18T00:34:59.555 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33351.log 2024-09-18T00:34:59.555 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33151.log.gz 2024-09-18T00:34:59.555 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.33351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33351.log.gz 2024-09-18T00:34:59.555 INFO:teuthology.orchestra.run.smithi167.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T00:34:59.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55802.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54220.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.55802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55802.log.gz 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57813.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54220.log.gz 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58931.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57813.log.gz 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-09-18T00:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58931.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52196.log 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40558.log 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52196.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52196.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56369.log 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58889.log 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40558.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56369.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58889.log.gz 2024-09-18T00:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51458.log 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58427.log 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51458.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58427.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52100.log 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52100.log.gz 2024-09-18T00:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40170.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48122.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37388.log.gz 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58595.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40170.log.gz 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55858.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48122.log.gz 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59100.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58595.log.gz 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55858.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.55858.log.gz 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.38109.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58469.log 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59100.log.gz 2024-09-18T00:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38109.log.gz 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58469.log.gz 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38318.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57172.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38318.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38318.log.gz 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48754.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57172.log.gz 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-09-18T00:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37604.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48754.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33529.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47734.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37604.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.33529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33529.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57875.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45713.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47734.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57875.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53113.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57814.log 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45713.log.gz 2024-09-18T00:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53113.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57814.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56831.log 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58847.log 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56831.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58847.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58679.log 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57173.log 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58679.log.gz 2024-09-18T00:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58175.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48616.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57173.log.gz 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58175.log.gz 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51938.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38115.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48616.log.gz 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51938.log.gz 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58637.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46455.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38115.log.gz 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40236.log 2024-09-18T00:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58637.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50254.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46455.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40236.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50254.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39106.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40060.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39106.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58553.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37783.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40060.log.gz 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56327.log 2024-09-18T00:34:59.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58553.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47884.log 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37783.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56327.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45853.log 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47884.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45853.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41087.log 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56873.log 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41087.log.gz 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2024-09-18T00:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56747.log 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56873.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58763.log 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56999.log 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56747.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58763.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54922.log 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56999.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54922.log.gz 2024-09-18T00:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37520.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38338.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37520.log.gz 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38121.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57517.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38338.log.gz 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38121.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38121.log.gz 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59015.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57517.log.gz 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59015.log.gz 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57713.log 2024-09-18T00:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56411.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57713.log.gz 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38822.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57516.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56411.log.gz 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37774.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38822.log.gz 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56663.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57516.log.gz 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37774.log.gz 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49007.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56663.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T00:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56663.log.gz 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46399.log 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49007.log.gz 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58259.log 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46399.log.gz 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58259.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.58259.log.gz 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51163.log 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52319.log 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51163.log.gz 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57177.log 2024-09-18T00:34:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52319.log.gz 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57180.log 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37469.log 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57177.log.gz 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39898.log 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57180.log.gz 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39307.log 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37469.log.gz 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39898.log.gz 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-09-18T00:34:59.636 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39307.log.gz 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.33227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49186.log 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50812.log 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38384.log 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr: 29.1% -- replaced with /var/log/ceph/ceph-client.admin.49186.log.gz 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50812.log.gz 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57178.log 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38384.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38384.log.gz -5 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52917.log 2024-09-18T00:34:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57812.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57178.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52917.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52917.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.58133.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50204.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57812.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38001.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58133.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50204.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57515.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38001.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2024-09-18T00:34:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56238.log 0.0% 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57515.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51220.log 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56238.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50612.log 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51220.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50612.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.56705.log 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50612.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54630.log 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56705.log.gz 2024-09-18T00:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39489.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49442.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54630.log.gz 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39489.log.gz 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58385.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49442.log.gz 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50741.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59140.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58385.log.gz 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38696.log 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50741.log.gz 2024-09-18T00:34:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59140.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.59140.log.gz 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55400.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38696.log.gz 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56915.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41188.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55400.log.gz 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50015.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56915.log.gz 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41188.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.41188.log.gz 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-mon.c.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53918.log 2024-09-18T00:34:59.641 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50015.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27404.log 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53918.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44820.log 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.27404.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27404.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40621.log 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44820.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38122.log 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40621.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2024-09-18T00:34:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45673.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51244.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38122.log.gz 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45673.log.gz 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46011.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51244.log.gz 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53608.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58217.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46011.log.gz 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52636.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53608.log.gz 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.58217.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2024-09-18T00:34:59.643 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58217.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52636.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57874.log 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57168.log 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57874.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57874.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.50526.log 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57168.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58805.log 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51667.log 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50526.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58805.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58805.log.gz 2024-09-18T00:34:59.644 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.58973.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51667.log.gz 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58511.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38381.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58973.log.gz 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46601.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58511.log.gz 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38381.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38381.log.gz -5 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39608.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46601.log.gz 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39608.log.gz 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2024-09-18T00:34:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47338.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.44941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37785.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53307.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47338.log.gz 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37785.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37785.log.gz 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52238.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53307.log.gz 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52238.log.gz 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59057.log 2024-09-18T00:34:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54589.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.33622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59057.log.gz 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56196.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54589.log.gz 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48940.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56196.log.gz 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48940.log.gz 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43486.log 2024-09-18T00:34:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56285.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43486.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38117.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53561.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56285.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38117.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53561.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44088.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2024-09-18T00:34:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44088.log.gz 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58721.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58721.log.gz 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38479.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38906.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38479.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38780.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38479.log.gz 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38864.log 2024-09-18T00:34:59.649 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38906.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40082.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38780.log: /var/log/ceph/ceph-client.admin.38864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38780.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38864.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40082.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57377.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42362.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57377.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38738.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57377.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55001.log 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41482.log: /var/log/ceph/ceph-client.admin.38738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2024-09-18T00:34:59.650 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38738.log.gz 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39107.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37776.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55001.log.gz 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39107.log.gz 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57816.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52770.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57816.log: /var/log/ceph/ceph-client.admin.37776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37776.log.gz 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57816.log.gz 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42312.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52770.log.gz 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42312.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2024-09-18T00:34:59.651 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42312.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45753.log: /var/log/ceph/ceph-client.admin.52040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49815.log 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42506.log 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.49815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49815.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56453.log 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42506.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56453.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41646.log 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T00:34:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56134.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41646.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56134.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40868.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57508.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45320.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40868.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57508.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57508.log.gz 2024-09-18T00:34:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38002.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45320.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44526.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47272.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38002.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41545.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44526.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47272.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40971.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41545.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.47673.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41545.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55236.log 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40971.log.gz 2024-09-18T00:34:59.654 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47673.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38968.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51619.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55236.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38968.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39108.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51619.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45793.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40669.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50877.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39108.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40669.log.gz 2024-09-18T00:34:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50463.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50877.log.gz 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39757.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50463.log.gz 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55755.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39757.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56537.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39757.log.gz 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55450.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55755.log.gz 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56537.log.gz 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54289.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58091.log 2024-09-18T00:34:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55450.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54289.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58091.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44241.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40477.log 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57181.log 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.40477.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40477.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57181.log.gz 2024-09-18T00:34:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38120.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50379.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38120.log.gzgzip 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58343.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50379.log.gz 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57513.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58343.log.gz 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gzgzip 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57513.log.gz 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37444.log 2024-09-18T00:34:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37444.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52367.log: 28.8% -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39022.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37786.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.39022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56957.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37786.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.39022.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56495.log 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56957.log.gz 2024-09-18T00:34:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57174.log 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56495.log.gz 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57510.log 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55135.log 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57174.log.gz 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57510.log.gz 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55135.log.gz 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56789.log 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2024-09-18T00:34:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45829.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56789.log.gz 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52515.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45829.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45829.log.gz 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58301.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52515.log: /var/log/ceph/ceph-client.admin.48436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52515.log.gz 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57505.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58301.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58301.log.gz 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52278.log 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57505.log: /var/log/ceph/ceph-client.admin.42740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57505.log.gz 2024-09-18T00:34:59.661 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39588.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52278.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52278.log.gz 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39969.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39588.log: /var/log/ceph/ceph-osd.3.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39588.log.gz 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58049.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.39969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39969.log.gz 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58049.log.gz 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38480.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42651.log 2024-09-18T00:34:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.38480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38480.log.gz 2024-09-18T00:34:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57733.log 2024-09-18T00:34:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42651.log.gz 2024-09-18T00:34:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57733.log.gz 2024-09-18T00:34:59.663 INFO:teuthology.orchestra.run.smithi081.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-18T00:34:59.663 INFO:teuthology.orchestra.run.smithi167.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-18T00:34:59.694 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-18T00:34:59.811 INFO:teuthology.orchestra.run.smithi081.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T00:34:59.866 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T00:35:00.602 INFO:teuthology.orchestra.run.smithi167.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-18T00:35:00.647 INFO:teuthology.orchestra.run.smithi081.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-18T00:35:02.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-18T00:35:02.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-18T00:35:02.363 INFO:teuthology.orchestra.run.smithi167.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-18T00:35:02.673 INFO:teuthology.orchestra.run.smithi167.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-18T00:35:02.898 INFO:teuthology.orchestra.run.smithi081.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T00:35:02.996 INFO:teuthology.orchestra.run.smithi081.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T00:35:02.998 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-18T00:35:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m3.510s 2024-09-18T00:35:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m8.496s 2024-09-18T00:35:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.470s 2024-09-18T00:35:03.603 INFO:teuthology.orchestra.run.smithi167.stderr: 95.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-18T00:35:03.605 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-18T00:35:03.605 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m4.076s 2024-09-18T00:35:03.605 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m10.746s 2024-09-18T00:35:03.606 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.475s 2024-09-18T00:35:03.606 INFO:tasks.ceph:Archiving logs... 2024-09-18T00:35:03.606 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/remote/smithi081/log 2024-09-18T00:35:03.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T00:35:04.857 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/remote/smithi167/log 2024-09-18T00:35:04.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T00:35:06.219 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T00:35:06.231 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T00:35:06.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T00:35:06.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T00:35:06.324 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T00:35:06.335 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T00:35:06.335 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T00:35:06.338 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T00:35:06.352 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-18T00:35:06.354 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-18T00:35:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T00:35:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-18T00:35:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -91us[ -94us] +/- 49ms 2024-09-18T00:35:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 -1505us[-1508us] +/- 63ms 2024-09-18T00:35:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +1898us[+1894us] +/- 72ms 2024-09-18T00:35:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:35:06.359 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T00:35:06.359 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-18T00:35:06.359 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 -93us[ -93us] +/- 49ms 2024-09-18T00:35:06.359 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -1490us[-1490us] +/- 63ms 2024-09-18T00:35:06.359 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +1907us[+1907us] +/- 72ms 2024-09-18T00:35:06.359 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T00:35:06.360 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T00:35:06.372 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T00:35:06.372 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T00:35:06.388 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T00:35:06.477 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T00:35:06.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T00:35:06.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:35:06.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T00:35:06.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:35:06.613 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T00:35:06.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T00:35:06.637 INFO:teuthology.task.internal:Duration was 652.692064 seconds 2024-09-18T00:35:06.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T00:35:06.652 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T00:35:06.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T00:35:06.655 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T00:35:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T00:35:06.696 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T00:35:07.011 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T00:35:07.011 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-18T00:35:07.011 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T00:35:07.032 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-18T00:35:07.032 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T00:35:07.074 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T00:35:07.075 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T00:35:07.077 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T00:35:07.141 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T00:35:07.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T00:35:07.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T00:35:07.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T00:35:07.345 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T00:35:07.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T00:35:07.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T00:35:07.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T00:35:07.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T00:35:07.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T00:35:07.433 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-18T00:35:07.458 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-18T00:35:07.478 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T00:35:07.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:35:07.511 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T00:35:07.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T00:35:07.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T00:35:07.542 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T00:35:07.543 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/remote/smithi081 2024-09-18T00:35:07.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T00:35:07.593 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909651/remote/smithi167 2024-09-18T00:35:07.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T00:35:07.631 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T00:35:07.632 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T00:35:07.634 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T00:35:07.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T00:35:07.692 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T00:35:07.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T00:35:07.710 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T00:35:07.711 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T00:35:07.713 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T00:35:07.725 INFO:teuthology.orchestra.run.smithi081.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 00:35 /home/ubuntu/cephtest 2024-09-18T00:35:07.736 INFO:teuthology.orchestra.run.smithi167.stdout: 265974 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 00:35 /home/ubuntu/cephtest 2024-09-18T00:35:07.737 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T00:35:07.746 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T00:35:07.767 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} duration: 652.6920638084412 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-18T00:35:07.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T00:35:07.841 INFO:teuthology.run:pass